Apr 20 16:59:29 devstack cinder-volume[72551]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 20 16:59:29 devstack cinder-volume[72551]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 20 16:59:29 devstack cinder-volume[72551]: we strongly recommend against using it for new projects. Apr 20 16:59:29 devstack cinder-volume[72551]: If you are already using Eventlet, we recommend migrating to a different Apr 20 16:59:29 devstack cinder-volume[72551]: framework. For more detail see Apr 20 16:59:29 devstack cinder-volume[72551]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 20 16:59:29 devstack cinder-volume[72551]: import eventlet # noqa Apr 20 16:59:30 devstack cinder-volume[72551]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 20 16:59:30 devstack cinder-volume[72551]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 20 16:59:30 devstack cinder-volume[72551]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 20 16:59:31 devstack cinder-volume[72551]: INFO dbcounter [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Registered counter for database cinder Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_db.sqlalchemy.engines [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG dbcounter [-] [72551] Writer thread running {{(pid=72551) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 20 16:59:31 devstack cinder-volume[72551]: INFO cinder.rpc [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 20 16:59:31 devstack cinder-volume[72551]: INFO cinder.rpc [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_db.sqlalchemy.engines [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 16:59:31 devstack cinder-volume[72551]: INFO cinder.volume.manager [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Determined volume DB was empty at startup. Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG cinder.volume.manager [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72551) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 20 16:59:31 devstack cinder-volume[72551]: INFO cinder.volume.manager [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 20 16:59:31 devstack cinder-volume[72551]: WARNING stevedore.named [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 20 16:59:31 devstack cinder-volume[72551]: WARNING castellan.key_manager [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 20 16:59:31 devstack cinder-volume[72551]: WARNING cinder.keymgr.conf_key_mgr [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG cinder.volume.drivers.lvm [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72551) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_concurrency.processutils [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72551) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_concurrency.processutils [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.246s {{(pid=72551) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_db.sqlalchemy.engines [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 16:59:31 devstack cinder-volume[72551]: INFO cinder.rpc [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 20 16:59:31 devstack cinder-volume[72551]: INFO cinder.rpc [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 20 16:59:31 devstack cinder-volume[72551]: WARNING stevedore.named [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 20 16:59:31 devstack cinder-volume[72551]: WARNING castellan.key_manager [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 20 16:59:31 devstack cinder-volume[72551]: INFO cinder.volume.manager [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_db.sqlalchemy.engines [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 16:59:31 devstack cinder-volume[72551]: INFO oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Starting 1 workers Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Started child 72659 {{(pid=72551) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Full set of CONF: {{(pid=72551) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] ******************************************************************************** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Configuration options gathered from: {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] ================================================================================ {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] allow_availability_zone_fallback = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72659]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] allow_compression_on_image_upload = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] allowed_direct_url_schemes = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] api_rate_limit = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] auth_strategy = keystone {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] az_cache_duration = 3600 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_availability_zone = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_host = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_stats_polling_interval = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backup_api_class = cinder.backup.api.API {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backup_name_template = backup-%s {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backup_use_same_host = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backup_use_temp_snapshot = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] chap_password = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] chap_username = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_internal_tenant_project_id = fd569d8ecb8c47699a439c4142809e14 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_internal_tenant_user_id = 99389123edba48078864f672c712530d {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cloned_volume_same_az = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cluster = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] compression_format = gzip {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] compute_api_class = cinder.compute.nova.API {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] config_dir = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] config_source = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] control_exchange = openstack {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] debug = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] default_availability_zone = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] default_group_type = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] default_volume_type = lvmdriver-1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] disk_geometry = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] driver_client_cert = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] driver_client_cert_key = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] driver_data_namespace = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] driver_ssl_cert_path = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] driver_ssl_cert_verify = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] driver_use_ssl = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] enable_force_upload = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] enable_new_services = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] enable_unsupported_driver = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] enforce_multipath_for_image_xfer = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] filter_function = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_api_insecure = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_api_servers = ['http://192.168.122.241/image'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_api_ssl_compression = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_ca_certificates_file = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_catalog_info = image:glance:publicURL {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_certfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_keyfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_num_retries = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance_request_timeout = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] goodness_function = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] graceful_shutdown_timeout = 5 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] group_api_class = cinder.group.api.API {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] host = devstack {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_compress_on_upload = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_conversion_address_space_limit = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_conversion_cpu_limit = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_conversion_disable = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_upload_use_cinder_backend = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_upload_use_internal_tenant = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_volume_cache_enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_volume_cache_max_count = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] image_volume_cache_max_size_gb = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] init_host_max_objects_retrieval = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] instance_format = [instance: %(uuid)s] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] iscsi_target_flags = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] iscsi_write_cache = on {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] iser_helper = tgtadm {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] iser_ip_address = 192.168.122.241 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] iser_port = 3260 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_color = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_config_append = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_dir = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_file = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_options = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_rotate_interval = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_rotate_interval_type = days {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] log_rotation_type = none {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72659]: INFO cinder.volume.manager [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] max_age = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] max_logfile_count = 30 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] max_logfile_size_mb = 200 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] max_over_subscription_ratio = 20.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] message_reap_interval = 86400 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] message_ttl = 2592000 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] migration_create_volume_timeout_secs = 300 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] monkey_patch = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] monkey_patch_modules = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] my_ip = 192.168.122.241 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] no_snapshot_gb_quota = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] num_iser_scan_tries = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] num_shell_tries = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] num_volume_device_scan_tries = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] nvmeof_conn_info_version = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] nvmet_ns_id = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] nvmet_port_id = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] osapi_max_limit = 1000 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] osapi_volume_ext_list = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] osapi_volume_listen_port = 8776 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] osapi_volume_use_ssl = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] osapi_volume_workers = 2 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] per_volume_size_limit = -1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] periodic_fuzzy_delay = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] periodic_interval = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] public_endpoint = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] publish_errors = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] quota_backup_gigabytes = 1000 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] quota_backups = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] quota_gigabytes = 1000 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] quota_groups = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] quota_snapshots = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] quota_volumes = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] rate_limit_burst = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] rate_limit_except_level = CRITICAL {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] rate_limit_interval = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] reinit_driver_count = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] replication_device = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] report_discard_supported = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] report_interval = 120 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] reservation_clean_interval = 86400 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] reservation_expire = 86400 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] reserved_image_namespaces = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] reserved_percentage = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] rpc_response_timeout = 120 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] run_external_periodic_tasks = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] scst_target_driver = iscsi {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] scst_target_iqn_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_down_time = 720 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] shell_completion = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] snapshot_name_template = snapshot-%s {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] snapshot_same_host = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] split_loggers = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] state_path = /opt/stack/data/cinder {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] storage_availability_zone = nova {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] storage_protocol = iSCSI {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] syslog_log_facility = LOG_USER {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] target_helper = lioadm {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] target_ip_address = 192.168.122.241 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] target_port = 3260 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] target_protocol = iscsi {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] target_secondary_ip_addresses = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:31 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] trace_flags = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] transport_url = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] until_refresh = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] use_chap_auth = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] use_default_quota_class = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] use_journal = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] use_json = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] use_multipath_for_image_xfer = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] use_stderr = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] use_syslog = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] verify_glance_signatures = enabled {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_api_class = cinder.volume.api.API {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_backend_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_clear = zero {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_clear_ionice = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_clear_size = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_copy_bps_limit = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_dd_blocksize = 1M {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_name_template = volume-%s {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_service_inithost_offload = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volume_usage_audit_period = month {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] zoning_mode = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.admin_password = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.admin_token = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.admin_user = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.auth_port = 35357 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.auth_protocol = https {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.auth_section = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.auth_type = password {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.auth_uri = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.auth_version = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.cache = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.certfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.identity_uri = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.include_service_catalog = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.insecure = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.interface = public {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.keyfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_password = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcache_username = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.region_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.service_type = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.241/identity {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.backend = dogpile.cache.null {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.backend_argument = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.backend_expiration_time = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.config_prefix = cache.oslo {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.debug_cache_backend = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.enable_retry_client = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.enable_socket_keepalive = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.enforce_fips_mode = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.expiration_time = 600 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.memcache_dead_retry = 300 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.memcache_pool_maxsize = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.memcache_sasl_enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.password = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.proxies = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.redis_db = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.redis_server = localhost:6379 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.retry_attempts = 2 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.retry_delay = 0.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.socket_keepalive_count = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.socket_keepalive_idle = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:32 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.socket_keepalive_interval = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.socket_timeout = 1.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.tls_allowed_ciphers = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.tls_cafile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.tls_certfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.tls_enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.tls_keyfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cache.username = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] coordination.backend_url = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.asyncio_connection = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.asyncio_slave_connection = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.backend = sqlalchemy {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.connection = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.connection_debug = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.connection_parameters = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.connection_recycle_time = 3600 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.connection_trace = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.db_inc_retry_interval = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.db_max_retries = 20 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.db_max_retry_interval = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.db_retry_interval = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.max_overflow = 50 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.max_pool_size = 5 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.max_retries = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.pool_timeout = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.retry_interval = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.slave_connection = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:32 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.sqlite_synchronous = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.synchronous_reader = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] database.use_db_reconnect = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.connection_string = messaging:// {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.es_doc_type = notification {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.es_scroll_size = 10000 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.es_scroll_time = 2m {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.filter_error_trace = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.hmac_keys = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.sentinel_service_name = mymaster {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.socket_timeout = 0.1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.trace_requests = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler.trace_sqlalchemy = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler_jaeger.process_tags = {} {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] profiler_otlp.service_name_prefix = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.enforce_new_defaults = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: WARNING oslo_config.cfg [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.enforce_scope = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.policy_default_rule = default {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.policy_file = policy.yaml {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] privsep_osbrick.group = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] privsep_osbrick.helper_command = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] privsep_osbrick.user = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_sys_admin.group = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_sys_admin.helper_command = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] cinder_sys_admin.user = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.auth_section = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.auth_type = password {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.cafile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.certfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.collect_timing = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.insecure = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.keyfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.send_service_user_token = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.split_loggers = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] service_user.timeout = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.auth_section = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.auth_type = password {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.certfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack sudo[72663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.collect_timing = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.insecure = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.keyfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack sudo[72663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.region_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.split_loggers = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] glance.timeout = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.backend_availability_zone = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.chap_password = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.chap_username = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.disk_geometry = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.driver_client_cert = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.driver_client_cert_key = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.driver_data_namespace = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.driver_use_ssl = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.extra_capabilities = {} {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.filter_function = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.goodness_function = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.iscsi_target_flags = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.iscsi_write_cache = on {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.iser_helper = tgtadm {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.iser_ip_address = 192.168.122.241 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.iser_port = 3260 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.lvm_share_target = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.lvm_type = auto {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.num_shell_tries = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.replication_device = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.report_discard_supported = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.reserved_percentage = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.target_helper = tgtadm {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.target_ip_address = 192.168.122.241 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.target_port = 3260 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.target_protocol = iscsi {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.trace_flags = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.unique_fqdn_network = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.use_chap_auth = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_backend_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_clear = zero {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_clear_ionice = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_clear_size = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_reports.file_event_handler = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_reports.log_dir = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.backend_host = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.chap_password = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.chap_username = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.disk_geometry = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.driver_client_cert = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.extra_capabilities = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.filter_function = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.goodness_function = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.iser_helper = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.iser_ip_address = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.iser_port = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.lvm_share_target = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.lvm_type = auto {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.num_shell_tries = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.replication_device = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.report_discard_supported = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.reserved_percentage = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.scst_target_driver = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.storage_protocol = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.target_helper = lioadm {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.target_ip_address = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.target_port = 3260 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.trace_flags = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.use_chap_auth = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_clear = zero {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_clear_size = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] lvmdriver-1.volumes_dir = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.ssl = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_notifications.driver = [] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] key_manager.fixed_key = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.barbican_api_version = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.barbican_endpoint = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.barbican_endpoint_type = public {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.barbican_region_name = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.cafile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.certfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.collect_timing = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.insecure = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.keyfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.number_of_retries = 60 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.retry_delay = 1 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.send_service_user_token = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.split_loggers = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.timeout = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.verify_ssl = True {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican.verify_ssl_path = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.auth_section = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.auth_type = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.cafile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.certfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.collect_timing = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.insecure = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.keyfile = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.split_loggers = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] barbican_service_user.timeout = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.approle_role_id = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.approle_secret_id = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.kv_mountpoint = secret {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.kv_path = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.kv_version = 2 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.namespace = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.root_token_id = **** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.ssl_ca_crt_file = None {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.timeout = 60.0 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.use_ssl = False {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 16:59:32 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] ******************************************************************************** {{(pid=72551) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 20 16:59:32 devstack sudo[72663]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:32 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:32 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:32 devstack sudo[72672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:32 devstack sudo[72672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:33 devstack sudo[72672]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:33 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.492s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:33 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 16:59:33 devstack cinder-volume[72659]: INFO cinder.brick.local_dev.lvm [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 20 16:59:33 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:33 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:33 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:33 devstack sudo[72933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 16:59:33 devstack sudo[72933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:33 devstack sudo[72933]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:33 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:33 devstack cinder-volume[72659]: DEBUG cinder.brick.local_dev.lvm [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72659) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 20 16:59:33 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:33 devstack sudo[73117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:33 devstack sudo[73117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:34 devstack sudo[73117]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:34 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.208s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:34 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:34 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:34 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:34 devstack sudo[73351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:34 devstack sudo[73351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:35 devstack sudo[73351]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:35 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:35 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:35 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:35 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:35 devstack sudo[73356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 20 16:59:35 devstack sudo[73356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:35 devstack sudo[73356]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:35 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.424s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:35 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:35 devstack sudo[73359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 16:59:35 devstack sudo[73359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:36 devstack sudo[73359]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:36 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:36 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:36 devstack sudo[73364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 16:59:36 devstack sudo[73364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:36 devstack sudo[73364]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:36 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:36 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:36 devstack sudo[73370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 16:59:36 devstack sudo[73370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:37 devstack sudo[73370]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:37 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:37 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:37 devstack sudo[73376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:37 devstack sudo[73376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:37 devstack sudo[73376]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:37 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:37 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:37 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:37 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:37 devstack sudo[73380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:37 devstack sudo[73380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:38 devstack sudo[73380]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:38 devstack cinder-volume[72659]: INFO cinder.volume.drivers.lvm [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:38 devstack sudo[73390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:38 devstack sudo[73390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:38 devstack sudo[73390]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG cinder.volume.drivers.lvm [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Updating volume stats {{(pid=72659) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:38 devstack sudo[73494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 16:59:38 devstack sudo[73494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:38 devstack sudo[73494]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:38 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:38 devstack sudo[73508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 16:59:38 devstack sudo[73508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:39 devstack sudo[73508]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:39 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:39 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:39 devstack sudo[73559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:39 devstack sudo[73559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:39 devstack sudo[73559]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:39 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:39 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:39 devstack sudo[73651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 16:59:39 devstack sudo[73651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:40 devstack sudo[73651]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:40 devstack cinder-volume[72659]: INFO cinder.volume.driver [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Driver hasn't implemented _init_vendor_properties() Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG cinder.volume.driver [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72659) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG oslo_db.sqlalchemy.engines [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG dbcounter [-] [72659] Writer thread running {{(pid=72659) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG cinder.db.sqlalchemy.api [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Building query based on filter {{(pid=72659) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG cinder.image.image_utils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72659) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Apr 20 16:59:40 devstack cinder-volume[72659]: INFO cinder.keymgr.migration [None req-d6109740-e3c8-4ea2-9c05-58738e302cf6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG cinder.volume.drivers.lvm [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Updating volume stats {{(pid=72659) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:40 devstack sudo[73657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 16:59:40 devstack sudo[73657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:40 devstack sudo[73657]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:40 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:40 devstack sudo[73663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 16:59:40 devstack sudo[73663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:41 devstack sudo[73663]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:41 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:41 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:41 devstack sudo[73666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:41 devstack sudo[73666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:41 devstack sudo[73666]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:41 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.485s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:41 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:41 devstack sudo[73670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 16:59:41 devstack sudo[73670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:41 devstack cinder-volume[72551]: DEBUG dbcounter [-] [72551] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72551) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 16:59:42 devstack sudo[73670]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:42 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:42 devstack cinder-volume[72659]: DEBUG cinder.manager [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Notifying Schedulers of capabilities ... {{(pid=72659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 16:59:42 devstack cinder-volume[72659]: INFO cinder.volume.manager [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Driver initialization completed successfully. Apr 20 16:59:42 devstack cinder-volume[72659]: INFO cinder.manager [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Initiating service 2 cleanup Apr 20 16:59:42 devstack cinder-volume[72659]: INFO cinder.manager [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Service 2 cleanup completed. Apr 20 16:59:42 devstack cinder-volume[72659]: DEBUG cinder.service [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Creating RPC server for service cinder-volume {{(pid=72659) start /opt/stack/cinder/cinder/service.py:231}} Apr 20 16:59:42 devstack cinder-volume[72659]: DEBUG cinder.service [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72659) start /opt/stack/cinder/cinder/service.py:237}} Apr 20 16:59:42 devstack cinder-volume[72659]: INFO cinder.volume.manager [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 20 16:59:42 devstack cinder-volume[72659]: DEBUG cinder.volume.drivers.lvm [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Updating volume stats {{(pid=72659) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 20 16:59:42 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:42 devstack sudo[73675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 16:59:42 devstack sudo[73675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:42 devstack sudo[73675]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:42 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:42 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:42 devstack sudo[73683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 16:59:42 devstack sudo[73683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:43 devstack sudo[73683]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:43 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:43 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:43 devstack sudo[73686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 16:59:43 devstack sudo[73686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:43 devstack sudo[73686]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:43 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:43 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 16:59:43 devstack sudo[73743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 16:59:43 devstack sudo[73743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 16:59:44 devstack sudo[73743]: pam_unix(sudo:session): session closed for user root Apr 20 16:59:44 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 16:59:44 devstack cinder-volume[72659]: INFO cinder.volume.manager [None req-86570615-8c34-4bfb-9a3b-94f32bf3d99f None None] Driver post RPC initialization completed successfully. Apr 20 16:59:54 devstack cinder-volume[72659]: DEBUG dbcounter [-] [72659] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72659) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 16:59:54 devstack cinder-volume[72659]: DEBUG dbcounter [-] [72659] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=72659) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:00:50 devstack cinder-volume[72659]: DEBUG oslo_service.periodic_task [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72659) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:00:50 devstack cinder-volume[72659]: DEBUG cinder.volume.drivers.lvm [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Updating volume stats {{(pid=72659) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 20 17:00:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:00:50 devstack sudo[78476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 17:00:50 devstack sudo[78476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:00:50 devstack sudo[78476]: pam_unix(sudo:session): session closed for user root Apr 20 17:00:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:00:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:00:50 devstack sudo[78479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 17:00:50 devstack sudo[78479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:00:51 devstack sudo[78479]: pam_unix(sudo:session): session closed for user root Apr 20 17:00:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:00:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:00:51 devstack sudo[78482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 17:00:51 devstack sudo[78482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:00:51 devstack sudo[78482]: pam_unix(sudo:session): session closed for user root Apr 20 17:00:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:00:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:00:51 devstack sudo[78485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 17:00:51 devstack sudo[78485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:00:51 devstack sudo[78485]: pam_unix(sudo:session): session closed for user root Apr 20 17:00:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:00:51 devstack cinder-volume[72659]: DEBUG cinder.manager [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Notifying Schedulers of capabilities ... {{(pid=72659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:01:50 devstack cinder-volume[72659]: DEBUG oslo_service.periodic_task [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72659) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:01:50 devstack cinder-volume[72659]: DEBUG cinder.volume.drivers.lvm [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Updating volume stats {{(pid=72659) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 20 17:01:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:01:50 devstack sudo[79863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 17:01:50 devstack sudo[79863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:01:50 devstack sudo[79863]: pam_unix(sudo:session): session closed for user root Apr 20 17:01:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:01:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:01:50 devstack sudo[79891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 17:01:50 devstack sudo[79891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:01:51 devstack sudo[79891]: pam_unix(sudo:session): session closed for user root Apr 20 17:01:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:01:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:01:51 devstack sudo[79919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 17:01:51 devstack sudo[79919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:01:51 devstack sudo[79919]: pam_unix(sudo:session): session closed for user root Apr 20 17:01:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:01:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:01:51 devstack sudo[79960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 17:01:51 devstack sudo[79960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:01:51 devstack sudo[79960]: pam_unix(sudo:session): session closed for user root Apr 20 17:01:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:01:51 devstack cinder-volume[72659]: DEBUG cinder.manager [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Notifying Schedulers of capabilities ... {{(pid=72659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:01:54 devstack cinder-volume[72659]: DEBUG dbcounter [-] [72659] Writing DB stats cinder:SELECT=1 {{(pid=72659) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:01:54 devstack cinder-volume[72659]: DEBUG dbcounter [-] [72659] Writing DB stats cinder:UPDATE=1 {{(pid=72659) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:02:50 devstack cinder-volume[72659]: DEBUG oslo_service.periodic_task [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72659) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:02:50 devstack cinder-volume[72659]: DEBUG cinder.volume.drivers.lvm [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Updating volume stats {{(pid=72659) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 20 17:02:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:02:50 devstack sudo[81323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 20 17:02:50 devstack sudo[81323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:02:50 devstack sudo[81323]: pam_unix(sudo:session): session closed for user root Apr 20 17:02:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:02:50 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:02:50 devstack sudo[81337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 17:02:50 devstack sudo[81337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:02:50 devstack sudo[81337]: pam_unix(sudo:session): session closed for user root Apr 20 17:02:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:02:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:02:51 devstack sudo[81340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 20 17:02:51 devstack sudo[81340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:02:51 devstack sudo[81340]: pam_unix(sudo:session): session closed for user root Apr 20 17:02:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:02:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:02:51 devstack sudo[81366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 20 17:02:51 devstack sudo[81366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:02:51 devstack sudo[81366]: pam_unix(sudo:session): session closed for user root Apr 20 17:02:51 devstack cinder-volume[72659]: DEBUG oslo_concurrency.processutils [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72659) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:02:51 devstack cinder-volume[72659]: DEBUG cinder.manager [None req-f3f0164d-9fe5-440e-b094-58ee214f6ab4 None None] Notifying Schedulers of capabilities ... {{(pid=72659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:03:03 devstack cinder-volume[72551]: INFO oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Caught SIGTERM, stopping children Apr 20 17:03:03 devstack cinder-volume[72551]: DEBUG oslo_concurrency.lockutils [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Acquiring lock "singleton_lock" {{(pid=72551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 20 17:03:03 devstack cinder-volume[72551]: DEBUG oslo_concurrency.lockutils [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Acquired lock "singleton_lock" {{(pid=72551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 20 17:03:03 devstack cinder-volume[72551]: DEBUG oslo_concurrency.lockutils [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Releasing lock "singleton_lock" {{(pid=72551) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 20 17:03:03 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Stop services. {{(pid=72551) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 20 17:03:03 devstack cinder-volume[72551]: DEBUG oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Killing children. {{(pid=72551) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 20 17:03:03 devstack cinder-volume[72551]: INFO oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Waiting on 1 children to exit Apr 20 17:03:07 devstack cinder-volume[72659]: DEBUG oslo_concurrency.lockutils [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Acquiring lock "singleton_lock" {{(pid=72659) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 20 17:03:07 devstack cinder-volume[72659]: DEBUG oslo_concurrency.lockutils [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Acquired lock "singleton_lock" {{(pid=72659) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 20 17:03:07 devstack cinder-volume[72659]: DEBUG oslo_concurrency.lockutils [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Releasing lock "singleton_lock" {{(pid=72659) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 20 17:03:07 devstack cinder-volume[72659]: WARNING amqp [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 20 17:03:07 devstack cinder-volume[72659]: WARNING amqp [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 20 17:03:07 devstack cinder-volume[72551]: INFO oslo_service.backend._eventlet.service [None req-9cabd06b-58e8-4b48-bd9c-6c992580b2f8 None None] Child 72659 exited with status 0 Apr 20 17:03:07 devstack cinder-volume[81723]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 20 17:03:07 devstack cinder-volume[81723]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 20 17:03:07 devstack cinder-volume[81723]: we strongly recommend against using it for new projects. Apr 20 17:03:07 devstack cinder-volume[81723]: If you are already using Eventlet, we recommend migrating to a different Apr 20 17:03:07 devstack cinder-volume[81723]: framework. For more detail see Apr 20 17:03:07 devstack cinder-volume[81723]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 20 17:03:07 devstack cinder-volume[81723]: import eventlet # noqa Apr 20 17:03:09 devstack cinder-volume[81723]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81723) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 20 17:03:09 devstack cinder-volume[81723]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81723) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 20 17:03:09 devstack cinder-volume[81723]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81723) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 20 17:03:10 devstack cinder-volume[81723]: INFO dbcounter [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Registered counter for database cinder Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_db.sqlalchemy.engines [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81723) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG dbcounter [-] [81723] Writer thread running {{(pid=81723) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 20 17:03:10 devstack cinder-volume[81723]: INFO cinder.rpc [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 20 17:03:10 devstack cinder-volume[81723]: INFO cinder.rpc [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_db.sqlalchemy.engines [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81723) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 17:03:10 devstack cinder-volume[81723]: INFO cinder.volume.manager [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Determined volume DB was empty at startup. Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG cinder.volume.manager [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81723) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 20 17:03:10 devstack cinder-volume[81723]: INFO cinder.volume.manager [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 20 17:03:10 devstack cinder-volume[81723]: WARNING stevedore.named [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 20 17:03:10 devstack cinder-volume[81723]: WARNING castellan.key_manager [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 20 17:03:10 devstack cinder-volume[81723]: WARNING cinder.keymgr.conf_key_mgr [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 20 17:03:10 devstack cinder-volume[81723]: INFO cinder.volume.manager [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_db.sqlalchemy.engines [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81723) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 17:03:10 devstack cinder-volume[81723]: INFO oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Starting 1 workers Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Started child 81839 {{(pid=81723) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Full set of CONF: {{(pid=81723) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] ******************************************************************************** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Configuration options gathered from: {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] ================================================================================ {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] allow_availability_zone_fallback = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] allow_compression_on_image_upload = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] allowed_direct_url_schemes = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] api_rate_limit = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] auth_strategy = keystone {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_availability_zone = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_host = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_stats_polling_interval = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backup_api_class = cinder.backup.api.API {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backup_name_template = backup-%s {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backup_use_same_host = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backup_use_temp_snapshot = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] chap_password = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] chap_username = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_internal_tenant_project_id = fd569d8ecb8c47699a439c4142809e14 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_internal_tenant_user_id = 99389123edba48078864f672c712530d {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cluster = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] compression_format = gzip {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] compute_api_class = cinder.compute.nova.API {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] config_dir = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] config_source = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] control_exchange = openstack {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] debug = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] default_availability_zone = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] default_group_type = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] default_volume_type = QuobyteHD {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] disk_geometry = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] driver_client_cert = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] driver_client_cert_key = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] driver_data_namespace = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] driver_ssl_cert_path = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] driver_ssl_cert_verify = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] driver_use_ssl = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] enable_new_services = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] enable_unsupported_driver = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] enabled_backends = ['QuobyteHD'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] enforce_multipath_for_image_xfer = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] filter_function = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_api_insecure = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81839]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_api_servers = ['http://192.168.122.241/image'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_api_ssl_compression = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_ca_certificates_file = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_catalog_info = image:glance:publicURL {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_certfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_keyfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_num_retries = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance_request_timeout = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] goodness_function = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] graceful_shutdown_timeout = 5 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] group_api_class = cinder.group.api.API {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] host = devstack {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_compress_on_upload = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_conversion_address_space_limit = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_conversion_cpu_limit = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_conversion_disable = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_upload_use_cinder_backend = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_upload_use_internal_tenant = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_volume_cache_enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_volume_cache_max_count = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] image_volume_cache_max_size_gb = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] init_host_max_objects_retrieval = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] instance_format = [instance: %(uuid)s] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] iscsi_target_flags = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] iscsi_write_cache = on {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] iser_helper = tgtadm {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] iser_ip_address = 192.168.122.241 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] iser_port = 3260 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_color = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_config_append = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_dir = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_file = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_options = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_rotate_interval = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_rotate_interval_type = days {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] log_rotation_type = none {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] max_age = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] max_logfile_count = 30 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] max_logfile_size_mb = 200 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] max_over_subscription_ratio = 20.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] message_reap_interval = 86400 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] message_ttl = 2592000 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] migration_create_volume_timeout_secs = 300 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] monkey_patch = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] monkey_patch_modules = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] my_ip = 192.168.122.241 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] no_snapshot_gb_quota = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] num_iser_scan_tries = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] num_shell_tries = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] num_volume_device_scan_tries = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] nvmeof_conn_info_version = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] nvmet_ns_id = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] nvmet_port_id = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] osapi_max_limit = 1000 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] osapi_volume_ext_list = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] osapi_volume_listen = 0.0.0.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] osapi_volume_listen_port = 8776 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] osapi_volume_use_ssl = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] osapi_volume_workers = 2 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] per_volume_size_limit = -1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] periodic_fuzzy_delay = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] periodic_interval = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] project_id_regex = [0-9a-f\-]+ {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] public_endpoint = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] publish_errors = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] quota_backup_gigabytes = 1000 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] quota_backups = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] quota_gigabytes = 1000 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] quota_groups = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] quota_snapshots = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] quota_volumes = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] rate_limit_burst = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] rate_limit_except_level = CRITICAL {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] rate_limit_interval = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] reinit_driver_count = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] replication_device = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] report_discard_supported = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] report_interval = 120 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] reservation_clean_interval = 86400 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] reservation_expire = 86400 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81839]: INFO cinder.volume.manager [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 20 17:03:10 devstack cinder-volume[81839]: DEBUG cinder.volume.drivers.remotefs [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81839) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] reserved_image_namespaces = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] reserved_percentage = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] rpc_response_timeout = 120 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] run_external_periodic_tasks = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] scst_target_driver = iscsi {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] scst_target_iqn_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_down_time = 720 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] shell_completion = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] snapshot_name_template = snapshot-%s {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] split_loggers = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] state_path = /opt/stack/data/cinder {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] storage_availability_zone = nova {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] storage_protocol = iSCSI {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] syslog_log_facility = LOG_USER {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] target_helper = lioadm {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] target_ip_address = 192.168.122.241 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] target_port = 3260 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] target_protocol = iscsi {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] target_secondary_ip_addresses = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] trace_flags = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] transfer_api_class = cinder.transfer.api.API {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] transport_url = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] until_refresh = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] use_chap_auth = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] use_default_quota_class = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] use_journal = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] use_json = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] use_multipath_for_image_xfer = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] use_stderr = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] use_syslog = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] verify_glance_signatures = enabled {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_api_class = cinder.volume.api.API {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_backend_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_clear = zero {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_clear_ionice = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_clear_size = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_copy_bps_limit = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_dd_blocksize = 1M {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_name_template = volume-%s {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_service_inithost_offload = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volume_usage_audit_period = month {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] zoning_mode = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_concurrency.disable_process_locking = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.admin_password = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.admin_token = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.admin_user = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.auth_admin_prefix = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.auth_port = 35357 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.auth_protocol = https {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.auth_section = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.auth_type = password {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.auth_uri = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.auth_version = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.cache = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.certfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.delay_auth_decision = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.http_connect_timeout = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.identity_uri = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.include_service_catalog = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.insecure = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.interface = public {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.keyfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_password = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcache_username = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.region_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.service_token_roles_required = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.service_type = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.token_cache_time = 300 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.241/identity {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.backend = dogpile.cache.null {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.backend_argument = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.backend_expiration_time = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.config_prefix = cache.oslo {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.debug_cache_backend = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.enable_retry_client = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.enable_socket_keepalive = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.enforce_fips_mode = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.expiration_time = 600 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.hashclient_retry_attempts = 2 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.memcache_dead_retry = 300 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.memcache_pool_maxsize = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.memcache_sasl_enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.password = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.proxies = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.redis_db = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.redis_sentinel_service_name = mymaster {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.redis_server = localhost:6379 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.retry_attempts = 2 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.retry_delay = 0.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.socket_keepalive_count = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.socket_keepalive_idle = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.socket_keepalive_interval = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.socket_timeout = 1.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.tls_allowed_ciphers = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.tls_cafile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.tls_certfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.tls_enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.tls_keyfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cache.username = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] coordination.backend_url = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.asyncio_connection = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.asyncio_slave_connection = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81839]: DEBUG cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81839) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 20 17:03:10 devstack cinder-volume[81839]: WARNING cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 20 17:03:10 devstack cinder-volume[81839]: WARNING cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.backend = sqlalchemy {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.connection = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.connection_debug = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.connection_parameters = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Running cmd (subprocess): mount.quobyte {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.connection_recycle_time = 3600 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.connection_trace = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.db_inc_retry_interval = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.db_max_retries = 20 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.db_max_retry_interval = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.db_retry_interval = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.max_overflow = 50 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.max_pool_size = 5 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.max_retries = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.mysql_wsrep_sync_wait = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.pool_timeout = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.retry_interval = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.slave_connection = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.sqlite_synchronous = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.synchronous_reader = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] database.use_db_reconnect = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.connection_string = messaging:// {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.es_doc_type = notification {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.es_scroll_size = 10000 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.es_scroll_time = 2m {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.filter_error_trace = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.hmac_keys = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.sentinel_service_name = mymaster {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.socket_timeout = 0.1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.trace_requests = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler.trace_sqlalchemy = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler_jaeger.process_tags = {} {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler_jaeger.service_name_prefix = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] profiler_otlp.service_name_prefix = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.enforce_new_defaults = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: WARNING oslo_config.cfg [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.enforce_scope = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.policy_default_rule = default {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.policy_file = policy.yaml {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_policy.remote_timeout = 60.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] privsep_osbrick.group = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] privsep_osbrick.helper_command = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] privsep_osbrick.user = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_sys_admin.group = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_sys_admin.helper_command = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] cinder_sys_admin.user = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.auth_section = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.auth_type = password {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.cafile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.certfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.collect_timing = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.insecure = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.keyfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.send_service_user_token = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.split_loggers = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] service_user.timeout = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.auth_section = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.auth_type = password {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.certfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.collect_timing = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.insecure = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.keyfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.region_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.split_loggers = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] glance.timeout = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.backend_availability_zone = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.chap_password = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.chap_username = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.disk_geometry = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.driver_client_cert = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.driver_client_cert_key = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.driver_data_namespace = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.driver_use_ssl = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.enable_unsupported_driver = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.extra_capabilities = {} {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.filter_function = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.goodness_function = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.iscsi_target_flags = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.iscsi_write_cache = on {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.iser_helper = tgtadm {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.iser_ip_address = 192.168.122.241 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.iser_port = 3260 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_host = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_login = admin {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_mount_options = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_password = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_private_key = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_share_path = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_ssh_port = 22 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.num_shell_tries = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.nvmet_port_id = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.quobyte_client_cfg = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.quobyte_volume_url = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.replication_device = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.report_discard_supported = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.reserved_percentage = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.scst_target_driver = iscsi {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.scst_target_iqn_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.storage_protocol = iSCSI {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.target_helper = tgtadm {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.target_ip_address = 192.168.122.241 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.target_port = 3260 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.target_protocol = iscsi {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.trace_flags = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.unique_fqdn_network = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.use_chap_auth = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volume_backend_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volume_clear = zero {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volume_clear_ionice = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volume_clear_size = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_reports.file_event_handler = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack quobyte-client[81843]: Reading configuration file: /etc/quobyte/client.cfg Apr 20 17:03:10 devstack quobyte-client[81843]: Invalid parameters found, error: missing mount point. Apr 20 17:03:10 devstack quobyte-client[81843]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 20 17:03:10 devstack quobyte-client[81843]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_reports.log_dir = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.backend_availability_zone = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.backend_host = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.chap_password = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.chap_username = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.chiscsi_conf = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.disk_geometry = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.driver_client_cert = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.driver_client_cert_key = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.driver_data_namespace = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.driver_use_ssl = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.extra_capabilities = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.filter_function = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.goodness_function = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.iscsi_target_flags = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.iscsi_write_cache = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.iser_helper = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.iser_ip_address = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.iser_port = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.iser_target_prefix = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_host = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_login = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_mount_options = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_password = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_private_key = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81839]: DEBUG cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=81839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_share_path = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81839]: INFO cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 ... Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_ssh_port = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 -c /etc/quobyte/client-cinder.cfg {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.num_shell_tries = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nvmet_ns_id = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.nvmet_port_id = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.replication_device = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.report_discard_supported = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.reserved_percentage = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.scst_target_driver = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.storage_protocol = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.target_helper = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.target_ip_address = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.target_port = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.target_prefix = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.target_protocol = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.trace_flags = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.unique_fqdn_network = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.use_chap_auth = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volume_clear = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volume_clear_ionice = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volume_clear_size = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] QuobyteHD.volumes_dir = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack sudo[81844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 -c /etc/quobyte/client-cinder.cfg Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack sudo[81844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.ssl = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.ssl_version = {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_notifications.driver = [] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_notifications.retry = -1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] oslo_messaging_notifications.transport_url = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] key_manager.fixed_key = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.barbican_api_version = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.barbican_endpoint = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.barbican_endpoint_type = public {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.barbican_region_name = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.cafile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.certfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.collect_timing = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.insecure = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.keyfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.number_of_retries = 60 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.retry_delay = 1 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.send_service_user_token = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.split_loggers = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.timeout = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.verify_ssl = True {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican.verify_ssl_path = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.auth_section = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.auth_type = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.cafile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.certfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.collect_timing = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.insecure = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.keyfile = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.split_loggers = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] barbican_service_user.timeout = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.approle_role_id = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.approle_secret_id = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.kv_mountpoint = secret {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.kv_path = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.kv_version = 2 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.namespace = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.root_token_id = **** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.ssl_ca_crt_file = None {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.timeout = 60.0 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.use_ssl = False {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:10 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] ******************************************************************************** {{(pid=81723) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 20 17:03:11 devstack sudo[81844]: pam_unix(sudo:session): session closed for user root Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.495s {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:11 devstack cinder-volume[81839]: INFO cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 succeeded Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=81839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.503s {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:11 devstack sudo[81913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:03:11 devstack sudo[81913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:03:11 devstack sudo[81913]: pam_unix(sudo:session): session closed for user root Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.407s {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:11 devstack cinder-volume[81839]: INFO cinder.volume.driver [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Driver hasn't implemented _init_vendor_properties() Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG cinder.volume.driver [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81839) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_db.sqlalchemy.engines [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG dbcounter [-] [81839] Writer thread running {{(pid=81839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG cinder.db.sqlalchemy.api [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Building query based on filter {{(pid=81839) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG cinder.image.image_utils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81839) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Apr 20 17:03:11 devstack cinder-volume[81839]: INFO cinder.keymgr.migration [None req-1389457d-eada-41f9-aa90-a8e7529ccf29 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=81839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=81839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:03:11 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:11 devstack sudo[81948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:03:11 devstack sudo[81948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:03:12 devstack sudo[81948]: pam_unix(sudo:session): session closed for user root Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.414s {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG cinder.manager [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Notifying Schedulers of capabilities ... {{(pid=81839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:03:12 devstack cinder-volume[81839]: INFO cinder.volume.manager [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Driver initialization completed successfully. Apr 20 17:03:12 devstack cinder-volume[81839]: INFO cinder.manager [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Initiating service 3 cleanup Apr 20 17:03:12 devstack cinder-volume[81839]: INFO cinder.manager [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Service 3 cleanup completed. Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG cinder.service [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Creating RPC server for service cinder-volume {{(pid=81839) start /opt/stack/cinder/cinder/service.py:231}} Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG cinder.service [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81839) start /opt/stack/cinder/cinder/service.py:237}} Apr 20 17:03:12 devstack cinder-volume[81839]: INFO cinder.volume.manager [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=81839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG cinder.volume.drivers.quobyte [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=81839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:12 devstack sudo[81955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:03:12 devstack sudo[81955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:03:12 devstack sudo[81955]: pam_unix(sudo:session): session closed for user root Apr 20 17:03:12 devstack cinder-volume[81839]: DEBUG oslo_concurrency.processutils [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.417s {{(pid=81839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:12 devstack cinder-volume[81839]: INFO cinder.volume.manager [None req-67638de7-807a-4811-aaf3-b5bd0a10ed67 None None] Driver post RPC initialization completed successfully. Apr 20 17:03:14 devstack cinder-volume[81723]: INFO oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Caught SIGTERM, stopping children Apr 20 17:03:14 devstack cinder-volume[81723]: DEBUG oslo_concurrency.lockutils [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Acquiring lock "singleton_lock" {{(pid=81723) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 20 17:03:14 devstack cinder-volume[81723]: DEBUG oslo_concurrency.lockutils [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Acquired lock "singleton_lock" {{(pid=81723) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 20 17:03:14 devstack cinder-volume[81723]: DEBUG oslo_concurrency.lockutils [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Releasing lock "singleton_lock" {{(pid=81723) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 20 17:03:14 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Stop services. {{(pid=81723) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 20 17:03:14 devstack cinder-volume[81723]: DEBUG oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Killing children. {{(pid=81723) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 20 17:03:14 devstack cinder-volume[81723]: INFO oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Waiting on 1 children to exit Apr 20 17:03:16 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Acquiring lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 20 17:03:16 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Acquired lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 20 17:03:16 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Releasing lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 20 17:03:16 devstack cinder-volume[81839]: WARNING amqp [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 20 17:03:16 devstack cinder-volume[81839]: WARNING amqp [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 20 17:03:16 devstack cinder-volume[81723]: INFO oslo_service.backend._eventlet.service [None req-0ab10b2a-b138-467b-8fe7-feb89e48ed0b None None] Child 81839 exited with status 0 Apr 20 17:03:16 devstack cinder-volume[82092]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 20 17:03:16 devstack cinder-volume[82092]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 20 17:03:16 devstack cinder-volume[82092]: we strongly recommend against using it for new projects. Apr 20 17:03:16 devstack cinder-volume[82092]: If you are already using Eventlet, we recommend migrating to a different Apr 20 17:03:16 devstack cinder-volume[82092]: framework. For more detail see Apr 20 17:03:16 devstack cinder-volume[82092]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 20 17:03:16 devstack cinder-volume[82092]: import eventlet # noqa Apr 20 17:03:18 devstack cinder-volume[82092]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82092) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 20 17:03:18 devstack cinder-volume[82092]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82092) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 20 17:03:18 devstack cinder-volume[82092]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82092) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 20 17:03:18 devstack cinder-volume[82092]: INFO dbcounter [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Registered counter for database cinder Apr 20 17:03:18 devstack cinder-volume[82092]: DEBUG oslo_db.sqlalchemy.engines [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 17:03:18 devstack cinder-volume[82092]: DEBUG dbcounter [-] [82092] Writer thread running {{(pid=82092) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 20 17:03:18 devstack cinder-volume[82092]: INFO cinder.rpc [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 20 17:03:18 devstack cinder-volume[82092]: INFO cinder.rpc [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 20 17:03:18 devstack cinder-volume[82092]: DEBUG oslo_db.sqlalchemy.engines [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 17:03:18 devstack cinder-volume[82092]: INFO cinder.volume.manager [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Determined volume DB was empty at startup. Apr 20 17:03:18 devstack cinder-volume[82092]: DEBUG cinder.volume.manager [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82092) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 20 17:03:18 devstack cinder-volume[82092]: WARNING stevedore.named [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 20 17:03:18 devstack cinder-volume[82092]: WARNING castellan.key_manager [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 20 17:03:18 devstack cinder-volume[82092]: WARNING cinder.keymgr.conf_key_mgr [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 20 17:03:18 devstack cinder-volume[82092]: INFO cinder.volume.manager [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_db.sqlalchemy.engines [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 17:03:19 devstack cinder-volume[82092]: INFO oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Starting 1 workers Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Started child 82240 {{(pid=82092) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Full set of CONF: {{(pid=82092) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] ******************************************************************************** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Configuration options gathered from: {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 20 17:03:19 devstack cinder-volume[82240]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] ================================================================================ {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] allow_availability_zone_fallback = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] allow_compression_on_image_upload = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] allowed_direct_url_schemes = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] api_rate_limit = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] auth_strategy = keystone {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_availability_zone = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_host = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_stats_polling_interval = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backup_api_class = cinder.backup.api.API {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backup_name_template = backup-%s {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backup_use_same_host = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backup_use_temp_snapshot = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] chap_password = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] chap_username = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_internal_tenant_project_id = fd569d8ecb8c47699a439c4142809e14 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_internal_tenant_user_id = 99389123edba48078864f672c712530d {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cluster = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] compression_format = gzip {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] compute_api_class = cinder.compute.nova.API {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] config_dir = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] config_source = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] control_exchange = openstack {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] debug = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] default_availability_zone = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] default_group_type = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] default_volume_type = QuobyteHD {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] disk_geometry = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] driver_client_cert = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] driver_client_cert_key = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] driver_data_namespace = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] driver_ssl_cert_path = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] driver_ssl_cert_verify = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] driver_use_ssl = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] enable_new_services = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] enable_unsupported_driver = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] enabled_backends = ['QuobyteHD'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] enforce_multipath_for_image_xfer = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] filter_function = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_api_insecure = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_api_servers = ['http://192.168.122.241/image'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_api_ssl_compression = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_ca_certificates_file = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_catalog_info = image:glance:publicURL {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_certfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_keyfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_num_retries = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance_request_timeout = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] goodness_function = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] graceful_shutdown_timeout = 5 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] group_api_class = cinder.group.api.API {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] host = devstack {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_compress_on_upload = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_conversion_address_space_limit = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_conversion_cpu_limit = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_conversion_disable = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_upload_use_cinder_backend = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_upload_use_internal_tenant = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_volume_cache_enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_volume_cache_max_count = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] image_volume_cache_max_size_gb = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] init_host_max_objects_retrieval = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] instance_format = [instance: %(uuid)s] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] iscsi_target_flags = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] iscsi_write_cache = on {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] iser_helper = tgtadm {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Starting volume driver QuobyteDriver (1.1.14) Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] iser_ip_address = 192.168.122.241 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] iser_port = 3260 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_color = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_config_append = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_dir = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_file = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_options = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_rotate_interval = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_rotate_interval_type = days {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] log_rotation_type = none {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82240) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] max_age = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] max_logfile_count = 30 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] max_logfile_size_mb = 200 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] max_over_subscription_ratio = 20.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] message_reap_interval = 86400 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] message_ttl = 2592000 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] migration_create_volume_timeout_secs = 300 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] monkey_patch = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] monkey_patch_modules = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] my_ip = 192.168.122.241 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] no_snapshot_gb_quota = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] num_iser_scan_tries = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] num_shell_tries = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] num_volume_device_scan_tries = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] nvmeof_conn_info_version = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] nvmet_ns_id = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] nvmet_port_id = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] osapi_max_limit = 1000 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] osapi_volume_ext_list = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] osapi_volume_listen_port = 8776 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] osapi_volume_use_ssl = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] osapi_volume_workers = 2 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] per_volume_size_limit = -1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] periodic_fuzzy_delay = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] periodic_interval = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] public_endpoint = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] publish_errors = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] quota_backup_gigabytes = 1000 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] quota_backups = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] quota_gigabytes = 1000 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] quota_groups = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] quota_snapshots = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] quota_volumes = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] rate_limit_burst = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] rate_limit_except_level = CRITICAL {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] rate_limit_interval = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] reinit_driver_count = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] replication_device = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] report_discard_supported = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] report_interval = 120 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] reservation_clean_interval = 86400 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] reservation_expire = 86400 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] reserved_image_namespaces = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] reserved_percentage = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] rpc_response_timeout = 120 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] run_external_periodic_tasks = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] scst_target_driver = iscsi {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] scst_target_iqn_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_down_time = 720 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] shell_completion = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] snapshot_name_template = snapshot-%s {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] split_loggers = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] state_path = /opt/stack/data/cinder {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] storage_availability_zone = nova {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] storage_protocol = iSCSI {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] syslog_log_facility = LOG_USER {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] target_helper = lioadm {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] target_ip_address = 192.168.122.241 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] target_port = 3260 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] target_protocol = iscsi {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] target_secondary_ip_addresses = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] trace_flags = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] transport_url = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] until_refresh = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] use_chap_auth = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] use_default_quota_class = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] use_journal = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] use_json = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] use_multipath_for_image_xfer = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] use_stderr = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] use_syslog = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] verify_glance_signatures = enabled {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_api_class = cinder.volume.api.API {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_backend_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_clear = zero {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_clear_ionice = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_clear_size = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_copy_bps_limit = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_dd_blocksize = 1M {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_name_template = volume-%s {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_service_inithost_offload = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volume_usage_audit_period = month {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] zoning_mode = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_concurrency.disable_process_locking = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.admin_password = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.admin_token = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.admin_user = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.auth_port = 35357 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.auth_protocol = https {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.auth_section = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.auth_type = password {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.auth_uri = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.auth_version = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.cache = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.certfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.identity_uri = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.include_service_catalog = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.insecure = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.interface = public {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.keyfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_password = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcache_username = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.region_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.service_type = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.241/identity {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.backend = dogpile.cache.null {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.backend_argument = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.backend_expiration_time = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.config_prefix = cache.oslo {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.debug_cache_backend = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.enable_retry_client = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.enable_socket_keepalive = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.enforce_fips_mode = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.expiration_time = 600 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.hashclient_retry_attempts = 2 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.memcache_dead_retry = 300 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.memcache_pool_maxsize = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.memcache_sasl_enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.password = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.proxies = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.redis_db = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.redis_server = localhost:6379 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.retry_attempts = 2 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.retry_delay = 0.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.socket_keepalive_count = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.socket_keepalive_idle = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.socket_keepalive_interval = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.socket_timeout = 1.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.tls_allowed_ciphers = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.tls_cafile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.tls_certfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.tls_enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.tls_keyfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cache.username = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] coordination.backend_url = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.asyncio_connection = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.asyncio_slave_connection = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.backend = sqlalchemy {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.connection = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.connection_debug = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.connection_parameters = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.connection_recycle_time = 3600 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.connection_trace = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.db_inc_retry_interval = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.db_max_retries = 20 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.db_max_retry_interval = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.db_retry_interval = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.max_overflow = 50 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.max_pool_size = 5 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.max_retries = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.mysql_wsrep_sync_wait = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.pool_timeout = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.retry_interval = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.slave_connection = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.sqlite_synchronous = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.synchronous_reader = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] database.use_db_reconnect = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.connection_string = messaging:// {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.es_doc_type = notification {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.es_scroll_size = 10000 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.es_scroll_time = 2m {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.filter_error_trace = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.hmac_keys = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.sentinel_service_name = mymaster {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.socket_timeout = 0.1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.trace_requests = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler.trace_sqlalchemy = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler_jaeger.process_tags = {} {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler_jaeger.service_name_prefix = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] profiler_otlp.service_name_prefix = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.enforce_new_defaults = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: WARNING oslo_config.cfg [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.enforce_scope = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.policy_default_rule = default {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.policy_file = policy.yaml {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82240) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 20 17:03:19 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 20 17:03:19 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Running cmd (subprocess): mount.quobyte {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] privsep_osbrick.group = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] privsep_osbrick.helper_command = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] privsep_osbrick.user = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_sys_admin.group = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_sys_admin.helper_command = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] cinder_sys_admin.user = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.auth_section = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.auth_type = password {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.cafile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.certfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.collect_timing = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.insecure = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.keyfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.send_service_user_token = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.split_loggers = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] service_user.timeout = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.auth_section = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.auth_type = password {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.certfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.collect_timing = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.insecure = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.keyfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.region_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.split_loggers = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] glance.timeout = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.backend_availability_zone = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.chap_password = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.chap_username = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.disk_geometry = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.driver_client_cert = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.driver_client_cert_key = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.driver_data_namespace = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.driver_use_ssl = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.extra_capabilities = {} {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.filter_function = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.goodness_function = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.iscsi_target_flags = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.iscsi_write_cache = on {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.iser_helper = tgtadm {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.iser_ip_address = 192.168.122.241 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.iser_port = 3260 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_host = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_login = admin {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_mount_options = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_password = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_private_key = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_share_path = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.num_shell_tries = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.quobyte_volume_url = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.replication_device = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.report_discard_supported = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.reserved_percentage = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.target_helper = tgtadm {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.target_ip_address = 192.168.122.241 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.target_port = 3260 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.target_protocol = iscsi {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack quobyte-client[82273]: Reading configuration file: /etc/quobyte/client.cfg Apr 20 17:03:19 devstack quobyte-client[82273]: Invalid parameters found, error: missing mount point. Apr 20 17:03:19 devstack quobyte-client[82273]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 20 17:03:19 devstack quobyte-client[82273]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.trace_flags = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.unique_fqdn_network = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.use_chap_auth = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volume_backend_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volume_clear = zero {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volume_clear_ionice = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volume_clear_size = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_reports.file_event_handler = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_reports.log_dir = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.backend_availability_zone = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.backend_host = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.chap_password = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.chap_username = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.chiscsi_conf = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.disk_geometry = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.driver_client_cert = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.driver_data_namespace = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.driver_use_ssl = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.extra_capabilities = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.filter_function = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.goodness_function = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.iser_helper = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.iser_ip_address = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.iser_port = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.iser_target_prefix = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_host = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_login = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_mount_options = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_password = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_private_key = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_share_path = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_ssh_port = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.num_shell_tries = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.nvmet_port_id = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.replication_device = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.report_discard_supported = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.reserved_percentage = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.scst_target_driver = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.storage_protocol = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.target_helper = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.target_ip_address = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.target_port = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.target_prefix = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.target_protocol = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.trace_flags = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.use_chap_auth = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volume_clear = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volume_clear_size = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] QuobyteHD.volumes_dir = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack sudo[82274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack sudo[82274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.ssl = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_notifications.driver = [] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_notifications.retry = -1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] key_manager.fixed_key = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.barbican_api_version = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.barbican_endpoint = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.barbican_endpoint_type = public {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.barbican_region_name = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.cafile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.certfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.collect_timing = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.insecure = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.keyfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.number_of_retries = 60 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.retry_delay = 1 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.send_service_user_token = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.split_loggers = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.timeout = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.verify_ssl = True {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican.verify_ssl_path = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.auth_section = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.auth_type = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.cafile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.certfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.collect_timing = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.insecure = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.keyfile = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.split_loggers = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] barbican_service_user.timeout = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.approle_role_id = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.approle_secret_id = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.kv_mountpoint = secret {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.kv_path = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.kv_version = 2 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.namespace = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.root_token_id = **** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.ssl_ca_crt_file = None {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.timeout = 60.0 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.use_ssl = False {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 20 17:03:19 devstack cinder-volume[82092]: DEBUG oslo_service.backend._eventlet.service [None req-c151906e-8748-4ea3-8f1f-a3673bc9d968 None None] ******************************************************************************** {{(pid=82092) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 20 17:03:20 devstack sudo[82274]: pam_unix(sudo:session): session closed for user root Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.742s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:20 devstack cinder-volume[82240]: INFO cinder.volume.driver [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Driver hasn't implemented _init_vendor_properties() Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.volume.driver [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82240) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_db.sqlalchemy.engines [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writer thread running {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.db.sqlalchemy.api [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Building query based on filter {{(pid=82240) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82240) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:20 devstack cinder-volume[82240]: INFO cinder.keymgr.migration [None req-6c4a2d2c-0186-4d07-ad08-24bdb0da5e4e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 20 17:03:20 devstack sudo[82328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:03:20 devstack sudo[82328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:03:20 devstack sudo[82328]: pam_unix(sudo:session): session closed for user root Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.409s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:03:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Driver initialization completed successfully. Apr 20 17:03:20 devstack cinder-volume[82240]: INFO cinder.manager [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Initiating service 3 cleanup Apr 20 17:03:20 devstack cinder-volume[82240]: INFO cinder.manager [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Service 3 cleanup completed. Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.service [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Creating RPC server for service cinder-volume {{(pid=82240) start /opt/stack/cinder/cinder/service.py:231}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.service [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82240) start /opt/stack/cinder/cinder/service.py:237}} Apr 20 17:03:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:03:20 devstack sudo[82339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:03:20 devstack sudo[82339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:03:20 devstack sudo[82339]: pam_unix(sudo:session): session closed for user root Apr 20 17:03:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.413s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:03:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5518d3dc-2ef3-4058-a9d0-961973d3869a None None] Driver post RPC initialization completed successfully. Apr 20 17:03:29 devstack cinder-volume[82092]: DEBUG dbcounter [-] [82092] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82092) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:03:30 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:03:30 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=3 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:04:25 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:04:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Flow 'volume_create_manager' (beae2185-47a4-49c0-b487-24fcf4fc7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:04:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0ac5d1-b273-4bbc-8e14-59bab6c7145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0ac5d1-b273-4bbc-8e14-59bab6c7145a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1479658225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f5fa5a-28d5-4559-b6a1-2c050ba37577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1282802e2a014e9fb96b79ac35293ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:04:26Z,use_quota=True,user_id='1e803c933d064f39b29e2aa59759758a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde8883d-1092-4638-af46-6010e58e30fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde8883d-1092-4638-af46-6010e58e30fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038dbe52-8d4e-42fa-a424-1da529f223fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038dbe52-8d4e-42fa-a424-1da529f223fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f5fa5a-28d5-4559-b6a1-2c050ba37577', 'volume_name': 'volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33a7eda-3db4-4e1e-96cc-384c9b28f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33a7eda-3db4-4e1e-96cc-384c9b28f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2ccd35-60ff-4497-a888-c3443ee5b92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:26 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Volume 07f5fa5a-28d5-4559-b6a1-2c050ba37577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577', 'volume_size': 1} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1479658225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f5fa5a-28d5-4559-b6a1-2c050ba37577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1282802e2a014e9fb96b79ac35293ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:04:26Z,use_quota=True,user_id='1e803c933d064f39b29e2aa59759758a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Creating volume 07f5fa5a-28d5-4559-b6a1-2c050ba37577 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:04:26 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:04:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:26 devstack sudo[82934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 1073741824 Apr 20 17:04:26 devstack sudo[82934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Flow 'volume_create_manager' (181a82e3-be9d-4d52-bb9b-fe51ec4efbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad78c61-cc15-442c-8f26-eb4c5b7ad592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad78c61-cc15-442c-8f26-eb4c5b7ad592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-217500696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632e6e9d-8dc8-42a1-abef-8eb17942ee96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d0759398c4a48b2e7fb4f471c205b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:04:27Z,use_quota=True,user_id='b1826d7b558143218ad6da0d57a0a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5208ba-2cef-4fa7-87ab-302d6ff7b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5208ba-2cef-4fa7-87ab-302d6ff7b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9716a9d8-6325-40ed-98ea-c7a99166b7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9716a9d8-6325-40ed-98ea-c7a99166b7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632e6e9d-8dc8-42a1-abef-8eb17942ee96', 'volume_name': 'volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3bdbf4-6868-4eb3-a3ad-bd145260ff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3bdbf4-6868-4eb3-a3ad-bd145260ff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4864bd-89bb-4bbf-8aa1-aa30791690f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:27 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Volume 632e6e9d-8dc8-42a1-abef-8eb17942ee96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96', 'volume_size': 1} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:27 devstack sudo[82934]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 1073741824" returned: 0 in 1.411s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:27 devstack sudo[83260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 Apr 20 17:04:27 devstack sudo[83260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:28 devstack sudo[83260]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577" returned: 0 in 1.038s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] <== create_volume: return (2502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.504s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-217500696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632e6e9d-8dc8-42a1-abef-8eb17942ee96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d0759398c4a48b2e7fb4f471c205b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:04:27Z,use_quota=True,user_id='b1826d7b558143218ad6da0d57a0a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Creating volume 632e6e9d-8dc8-42a1-abef-8eb17942ee96 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:04:28 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2ccd35-60ff-4497-a888-c3443ee5b92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2e883f-63a6-4bc9-b6b5-c09b669ad69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:28 devstack sudo[83264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 1073741824 Apr 20 17:04:28 devstack sudo[83264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:28 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Volume volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 (07f5fa5a-28d5-4559-b6a1-2c050ba37577): created successfully Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2e883f-63a6-4bc9-b6b5-c09b669ad69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Flow 'volume_create_manager' (beae2185-47a4-49c0-b487-24fcf4fc7870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:04:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-62175985-b4e1-482c-ab72-34eacc6fcde8 tempest-DeleteServersTestJSON-200133755 None] Created volume successfully. Apr 20 17:04:29 devstack sudo[83264]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 1073741824" returned: 0 in 1.215s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:29 devstack sudo[83275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 Apr 20 17:04:29 devstack sudo[83275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:04:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:30 devstack sudo[83281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:04:30 devstack sudo[83281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:30 devstack sudo[83275]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96" returned: 0 in 0.999s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4864bd-89bb-4bbf-8aa1-aa30791690f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e6afdd-a73e-4495-99b0-60bd65a666d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:30 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Volume volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 (632e6e9d-8dc8-42a1-abef-8eb17942ee96): created successfully Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e6afdd-a73e-4495-99b0-60bd65a666d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Flow 'volume_create_manager' (181a82e3-be9d-4d52-bb9b-fe51ec4efbff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:04:30 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1d24a7fc-a6ce-44cc-8c1c-93878753c2e1 tempest-VolumesAdminNegativeTest-1428411866 None] Created volume successfully. Apr 20 17:04:31 devstack sudo[83281]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 1.524s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:31 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:04:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Acquiring lock "cinder-632e6e9d-8dc8-42a1-abef-8eb17942ee96-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:04:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Lock "cinder-632e6e9d-8dc8-42a1-abef-8eb17942ee96-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:04:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Acquiring lock "cinder-quobyte-632e6e9d-8dc8-42a1-abef-8eb17942ee96" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:04:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Lock "cinder-quobyte-632e6e9d-8dc8-42a1-abef-8eb17942ee96" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:04:32 devstack cinder-volume[82240]: INFO oslo.privsep.daemon [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzfpt996d/privsep.sock'] Apr 20 17:04:32 devstack sudo[83312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzfpt996d/privsep.sock Apr 20 17:04:32 devstack sudo[83312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: Apr 20 17:04:32 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 20 17:04:33 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:04:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Flow 'volume_create_manager' (a4635421-248e-4042-b006-273fa3564fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:04:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4882ea4d-4191-463c-86bc-848086f9e7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: Apr 20 17:04:33 devstack cinder-volume[82240]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 20 17:04:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4882ea4d-4191-463c-86bc-848086f9e7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1664494676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6218033e-4afa-43ea-92a0-777346b9043b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='771fc3aa891c47ee99be254b8d27c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:04:34Z,use_quota=True,user_id='7d309251fcd14c8491f4379db2c249be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9909546c-0d04-4898-b8e9-e42df7ef5d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9909546c-0d04-4898-b8e9-e42df7ef5d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b98f9f1-c5f2-44d0-8371-bf2de62376fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b98f9f1-c5f2-44d0-8371-bf2de62376fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6218033e-4afa-43ea-92a0-777346b9043b', 'volume_name': 'volume-6218033e-4afa-43ea-92a0-777346b9043b', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d0e395-d624-4af5-b04e-3ddba9f670c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d0e395-d624-4af5-b04e-3ddba9f670c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ec9929-2bdb-42ef-ac2b-95819b45b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:34 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Volume 6218033e-4afa-43ea-92a0-777346b9043b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6218033e-4afa-43ea-92a0-777346b9043b', 'volume_size': 1} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1664494676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6218033e-4afa-43ea-92a0-777346b9043b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='771fc3aa891c47ee99be254b8d27c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:04:34Z,use_quota=True,user_id='7d309251fcd14c8491f4379db2c249be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Creating volume 6218033e-4afa-43ea-92a0-777346b9043b {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:04:34 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:04:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:34 devstack sudo[83320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b 1073741824 Apr 20 17:04:34 devstack sudo[83320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:35 devstack sudo[83320]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b 1073741824" returned: 0 in 1.122s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:35 devstack sudo[83328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b Apr 20 17:04:35 devstack sudo[83328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:35 devstack sudo[83312]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:35 devstack cinder-volume[82240]: INFO oslo.privsep.daemon [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Spawned new privsep daemon via rootwrap Apr 20 17:04:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Accepted privsep connection to /tmp/tmpzfpt996d/privsep.sock {{(pid=82240) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 20 17:04:35 devstack cinder-volume[82240]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 20 17:04:35 devstack cinder-volume[82240]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 20 17:04:35 devstack cinder-volume[82240]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 20 17:04:35 devstack cinder-volume[82240]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83323 Apr 20 17:04:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f282cb07-dfeb-445b-bbe0-f809db33cc3a]: (2,) {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:04:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc22432f-1a76-4156-8118-a2fd6946412c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:04:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:35 devstack sudo[83331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 Apr 20 17:04:35 devstack sudo[83331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:36 devstack sudo[83328]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b" returned: 0 in 0.848s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ec9929-2bdb-42ef-ac2b-95819b45b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6218033e-4afa-43ea-92a0-777346b9043b', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6917c6-dc1a-48e0-b296-07505c79ff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:04:36 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Volume volume-6218033e-4afa-43ea-92a0-777346b9043b (6218033e-4afa-43ea-92a0-777346b9043b): created successfully Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6917c6-dc1a-48e0-b296-07505c79ff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Flow 'volume_create_manager' (a4635421-248e-4042-b006-273fa3564fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:04:36 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ca6a65aa-7a57-45cf-89a0-0383815adfe5 tempest-ServerRescueNegativeTestJSON-837996473 None] Created volume successfully. Apr 20 17:04:36 devstack cinder-volume[82240]: WARNING py.warnings [req-23e93c5e-c316-4646-8698-505f800cc88e req-27318c26-e7b9-48dd-ad6e-4c67f09930d2 tempest-DeleteServersTestJSON-200133755 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 20 17:04:36 devstack cinder-volume[82240]: .first() Apr 20 17:04:36 devstack cinder-volume[82240]: Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-23e93c5e-c316-4646-8698-505f800cc88e req-27318c26-e7b9-48dd-ad6e-4c67f09930d2 tempest-DeleteServersTestJSON-200133755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-23e93c5e-c316-4646-8698-505f800cc88e req-27318c26-e7b9-48dd-ad6e-4c67f09930d2 tempest-DeleteServersTestJSON-200133755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7ca78c-139d-49fa-90d7-87b1498eadd8]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:04:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-23e93c5e-c316-4646-8698-505f800cc88e req-27318c26-e7b9-48dd-ad6e-4c67f09930d2 tempest-DeleteServersTestJSON-200133755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:36 devstack sudo[83345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 Apr 20 17:04:36 devstack sudo[83345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:37 devstack sudo[83331]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96" returned: 0 in 1.554s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:37 devstack sudo[83351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96 Apr 20 17:04:37 devstack sudo[83351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:38 devstack sudo[83345]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-23e93c5e-c316-4646-8698-505f800cc88e req-27318c26-e7b9-48dd-ad6e-4c67f09930d2 tempest-DeleteServersTestJSON-200133755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577" returned: 0 in 1.430s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-23e93c5e-c316-4646-8698-505f800cc88e req-27318c26-e7b9-48dd-ad6e-4c67f09930d2 tempest-DeleteServersTestJSON-200133755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.465s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-23e93c5e-c316-4646-8698-505f800cc88e req-27318c26-e7b9-48dd-ad6e-4c67f09930d2 tempest-DeleteServersTestJSON-200133755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0', 'name': 'volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f267077-d17d-4b9c-b0c7-44f4d5382978', 'enforce_multipath': True} {{(pid=82240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 20 17:04:38 devstack sudo[83351]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-632e6e9d-8dc8-42a1-abef-8eb17942ee96" returned: 0 in 1.292s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Lock "cinder-quobyte-632e6e9d-8dc8-42a1-abef-8eb17942ee96" released by "delete_volume" :: held 6.179s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:04:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-23e93c5e-c316-4646-8698-505f800cc88e req-27318c26-e7b9-48dd-ad6e-4c67f09930d2 tempest-DeleteServersTestJSON-200133755 None] attachment_update completed successfully. Apr 20 17:04:38 devstack cinder-volume[82240]: WARNING cinder.quota [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:04:38 devstack cinder-volume[82240]: WARNING cinder.quota [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Created reservations ['96558a21-f896-498f-b79e-3388ee9dda6e', 'cb99825b-0f7d-4cb7-acfa-4e84d73722d1', 'eb03acb5-adad-491f-af71-75761d1aaabb', '93a1cacf-52a2-4de1-a314-babf16885127'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:04:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:04:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:39 devstack sudo[83360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:04:39 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:40 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 1.408s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:40 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:04:40 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Deleted volume successfully. Apr 20 17:04:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1276c1d5-41ed-445d-8661-af7f68d7f08d tempest-VolumesAdminNegativeTest-1428411866 None] Lock "cinder-632e6e9d-8dc8-42a1-abef-8eb17942ee96-delete_volume" released by "delete_volume" :: held 8.271s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:04:48 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=24,cinder:SELECT=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:04:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-b003cb12-ddbf-4503-87f8-be9d298520b8 req-acb9be57-7be2-4684-9445-2bc2f8a73488 tempest-DeleteServersTestJSON-200133755 None] Terminate volume connection completed successfully. Apr 20 17:04:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-b003cb12-ddbf-4503-87f8-be9d298520b8 req-acb9be57-7be2-4684-9445-2bc2f8a73488 tempest-DeleteServersTestJSON-200133755 None] Deleting attachment 5f267077-d17d-4b9c-b0c7-44f4d5382978. {{(pid=82240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 20 17:04:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Acquiring lock "cinder-07f5fa5a-28d5-4559-b6a1-2c050ba37577-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:04:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Lock "cinder-07f5fa5a-28d5-4559-b6a1-2c050ba37577-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:04:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Acquiring lock "cinder-quobyte-07f5fa5a-28d5-4559-b6a1-2c050ba37577" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:04:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Lock "cinder-quobyte-07f5fa5a-28d5-4559-b6a1-2c050ba37577" acquired by "delete_volume" :: waited 0.035s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:04:52 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a2f3e0-71a3-4433-9dff-ceba3061acca]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:04:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:52 devstack sudo[83925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 Apr 20 17:04:53 devstack sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:53 devstack sudo[83925]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577" returned: 0 in 0.837s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:53 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577 Apr 20 17:04:53 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:54 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-07f5fa5a-28d5-4559-b6a1-2c050ba37577" returned: 0 in 0.893s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Lock "cinder-quobyte-07f5fa5a-28d5-4559-b6a1-2c050ba37577" released by "delete_volume" :: held 1.768s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Created reservations ['18c7dc40-04e9-4267-8f9e-fe39b2352cb9', '4613f38a-bda8-4d46-9d4a-6c66bce4b935', 'ec98efc5-0816-4d8b-b6aa-bf050f55a367', '14d1d831-f8c9-49bd-8c50-0dbc31277a03'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:54 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:04:54 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:55 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.986s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:55 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:04:55 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Deleted volume successfully. Apr 20 17:04:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd3787eb-c8ef-4ba4-9e9b-2af67bcbdc5e tempest-DeleteServersTestJSON-200133755 None] Lock "cinder-07f5fa5a-28d5-4559-b6a1-2c050ba37577-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:04:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Acquiring lock "cinder-6218033e-4afa-43ea-92a0-777346b9043b-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:04:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "cinder-6218033e-4afa-43ea-92a0-777346b9043b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:04:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Acquiring lock "cinder-quobyte-6218033e-4afa-43ea-92a0-777346b9043b" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:04:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "cinder-quobyte-6218033e-4afa-43ea-92a0-777346b9043b" acquired by "delete_volume" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:04:57 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7201f0-f694-41c0-ac89-b1bf6576b990]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:04:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:57 devstack sudo[84036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b Apr 20 17:04:57 devstack sudo[84036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:58 devstack sudo[84036]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b" returned: 0 in 0.851s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:58 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b Apr 20 17:04:58 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:04:59 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6218033e-4afa-43ea-92a0-777346b9043b" returned: 0 in 0.821s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "cinder-quobyte-6218033e-4afa-43ea-92a0-777346b9043b" released by "delete_volume" :: held 1.796s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Created reservations ['2d04f793-1f9e-4d90-bcbd-464d58caa6be', '2757f876-7f43-43ea-bcc4-d76374ab2133', '49728a11-c76e-4241-a705-89f93ceebcd0', '3389719a-30a7-48d4-9bb5-e4d233d5669a'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:04:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:04:59 devstack sudo[84047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:04:59 devstack sudo[84047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:00 devstack sudo[84047]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.933s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:00 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:00 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Deleted volume successfully. Apr 20 17:05:00 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9cd3d5bb-70a9-43b6-a140-baddcb35d8be tempest-ServerRescueNegativeTestJSON-837996473 None] Lock "cinder-6218033e-4afa-43ea-92a0-777346b9043b-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:09 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=18 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:05:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3e43edc7-ba1a-49a9-98aa-4b6199a3f935 tempest-GroupsV320Test-319124304 None] Group tempest-GroupsV320Test-Group-504254783: creating Apr 20 17:05:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3e43edc7-ba1a-49a9-98aa-4b6199a3f935 tempest-GroupsV320Test-319124304 None] Group tempest-GroupsV320Test-Group-504254783: created successfully Apr 20 17:05:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3e43edc7-ba1a-49a9-98aa-4b6199a3f935 tempest-GroupsV320Test-319124304 None] Create group completed successfully. Apr 20 17:05:11 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Created reservations ['fac3e258-00ac-4d8e-a2e5-69074d7064b7'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:05:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:11 devstack sudo[84157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:11 devstack sudo[84157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:12 devstack sudo[84157]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.537s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:12 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:12 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8b76b3aa-1568-496a-858e-c06d8ec664ff tempest-GroupsV320Test-319124304 None] Delete group completed successfully. Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Flow 'volume_create_manager' (758b65bc-0cd9-426c-af07-071e134349a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae82d5e2-825b-4828-a42d-da80780df84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae82d5e2-825b-4828-a42d-da80780df84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:19Z,deleted=False,deleted_at=None,display_description='',display_name='895a39fc-a689-4afa-bda5-676ea2601d86-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eac0ae7-a603-4d8f-a01f-6b9ada1779f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a06b529e814daead58465e085916dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:19Z,use_quota=True,user_id='142abd77d1e64600b76c5162dcf0811e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b916ee95-c774-494b-9f85-9ceb93e0d381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b916ee95-c774-494b-9f85-9ceb93e0d381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1732fde-4441-4128-b1ee-08562529783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1732fde-4441-4128-b1ee-08562529783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eac0ae7-a603-4d8f-a01f-6b9ada1779f5', 'volume_name': 'volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0091958-1b9b-4b2c-9638-1d5d50995ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0091958-1b9b-4b2c-9638-1d5d50995ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78da10f3-fada-4da4-9ad9-d79e505eef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:18 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Volume 8eac0ae7-a603-4d8f-a01f-6b9ada1779f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5', 'volume_size': 1} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:19Z,deleted=False,deleted_at=None,display_description='',display_name='895a39fc-a689-4afa-bda5-676ea2601d86-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eac0ae7-a603-4d8f-a01f-6b9ada1779f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a06b529e814daead58465e085916dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:19Z,use_quota=True,user_id='142abd77d1e64600b76c5162dcf0811e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Creating volume 8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:05:18 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:05:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:19 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 1073741824 Apr 20 17:05:19 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:20 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 1073741824" returned: 0 in 1.177s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:20 devstack sudo[84211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 Apr 20 17:05:20 devstack sudo[84211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=35,cinder:INSERT=10,cinder:UPDATE=30,cinder:DELETE=5 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:05:21 devstack sudo[84211]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5" returned: 0 in 1.214s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] <== create_volume: return (2442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78da10f3-fada-4da4-9ad9-d79e505eef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46682571-6c15-46d9-8471-6884ddd2999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:21 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Volume volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 (8eac0ae7-a603-4d8f-a01f-6b9ada1779f5): created successfully Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46682571-6c15-46d9-8471-6884ddd2999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Flow 'volume_create_manager' (758b65bc-0cd9-426c-af07-071e134349a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:21 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-29b234e4-6683-4896-883c-1121466a6016 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Created volume successfully. Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Flow 'volume_create_manager' (3484a4d4-b4a1-4ab6-9557-bed2043d51aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc32f64-93e9-4161-956b-88ee3c3d9cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc32f64-93e9-4161-956b-88ee3c3d9cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1866301515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ade9a28-0c44-46b9-ad87-f9271cf78ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0c29fac284c9aaec078be1bd35743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:22Z,use_quota=True,user_id='23ea6cba96b744c2b0d770abd0607a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ff713f-98c4-4ed4-9287-16e0cdaf2c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ff713f-98c4-4ed4-9287-16e0cdaf2c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a7f32c-5463-4497-81d6-bf0c0fd9ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a7f32c-5463-4497-81d6-bf0c0fd9ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ade9a28-0c44-46b9-ad87-f9271cf78ab5', 'volume_name': 'volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9609a9-daeb-412a-8bf5-e1b6bec1851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9609a9-daeb-412a-8bf5-e1b6bec1851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a3c9ea-41db-4b87-910d-c73bd300cb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:21 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Volume 3ade9a28-0c44-46b9-ad87-f9271cf78ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5', 'volume_size': 1} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1866301515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ade9a28-0c44-46b9-ad87-f9271cf78ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a0c29fac284c9aaec078be1bd35743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:22Z,use_quota=True,user_id='23ea6cba96b744c2b0d770abd0607a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Creating volume 3ade9a28-0c44-46b9-ad87-f9271cf78ab5 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:05:21 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:05:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:22 devstack sudo[84241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 1073741824 Apr 20 17:05:22 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-f842dc5e-5f67-4b5c-90fb-fc8f4c68f3ba tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:22 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 1073741824" returned: 0 in 0.750s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:22 devstack sudo[84255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 Apr 20 17:05:22 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:23 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" returned: 0 in 0.627s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-f842dc5e-5f67-4b5c-90fb-fc8f4c68f3ba tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.103s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a3c9ea-41db-4b87-910d-c73bd300cb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc23649-8405-43ed-8fb0-e8eae6b0c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5161fd51-8c96-48a7-b7ed-88b0fc19cbf7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-f842dc5e-5f67-4b5c-90fb-fc8f4c68f3ba tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:23 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Volume volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 (3ade9a28-0c44-46b9-ad87-f9271cf78ab5): created successfully Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc23649-8405-43ed-8fb0-e8eae6b0c66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Flow 'volume_create_manager' (3484a4d4-b4a1-4ab6-9557-bed2043d51aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:23 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-3c71b08c-bdc1-4573-b837-6874deffcf02 req-d4566970-277e-4ba5-9e6b-426ce59e2d95 tempest-VolumesSnapshotsTestJSON-1535984636 None] Created volume successfully. Apr 20 17:05:23 devstack sudo[84260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 Apr 20 17:05:23 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:24 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-f842dc5e-5f67-4b5c-90fb-fc8f4c68f3ba tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5" returned: 0 in 0.676s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-f842dc5e-5f67-4b5c-90fb-fc8f4c68f3ba tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.696s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-f842dc5e-5f67-4b5c-90fb-fc8f4c68f3ba tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0', 'name': 'volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '970057dd-8a51-484d-879b-f87a79c0d5a3', 'enforce_multipath': True} {{(pid=82240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 20 17:05:24 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-fab09a68-f28b-4fcb-9548-efe51d65ec0d req-f842dc5e-5f67-4b5c-90fb-fc8f4c68f3ba tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] attachment_update completed successfully. Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Creating offline snapshot a082de89-0d68-42de-b126-1f2425793c2f of volume 3ade9a28-0c44-46b9-ad87-f9271cf78ab5 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53ea1d-7e63-4e84-8a98-d6cfe4501de5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:24 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 Apr 20 17:05:24 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:24 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" returned: 0 in 0.722s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:24 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f 1G Apr 20 17:05:25 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:25 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f 1G" returned: 0 in 0.740s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:25 devstack sudo[84275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f Apr 20 17:05:25 devstack sudo[84275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:26 devstack sudo[84275]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f" returned: 0 in 0.753s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:26 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f is being set with open permissions: ugo+rw Apr 20 17:05:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:26 devstack sudo[84352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f Apr 20 17:05:26 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:27 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f" returned: 0 in 0.840s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:27 devstack sudo[84362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.info Apr 20 17:05:27 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:28 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.info" returned: 0 in 0.730s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:28 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.info is being set with open permissions: ugo+rw Apr 20 17:05:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:28 devstack sudo[84371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.info Apr 20 17:05:28 devstack sudo[84371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:28 devstack sudo[84371]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.info" returned: 0 in 0.718s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.627s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-bc93b128-0ba0-41f3-9153-2af1c71e72b7 req-59e27379-992a-492f-8621-98f1fd673baa tempest-VolumesSnapshotsTestJSON-1535984636 None] Create snapshot completed successfully Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "cinder-a082de89-0d68-42de-b126-1f2425793c2f-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-a082de89-0d68-42de-b126-1f2425793c2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "cinder-quobyte-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-quobyte-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "cinder-quobyte-a082de89-0d68-42de-b126-1f2425793c2f" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-quobyte-a082de89-0d68-42de-b126-1f2425793c2f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Deleting offline snapshot a082de89-0d68-42de-b126-1f2425793c2f of volume 3ade9a28-0c44-46b9-ad87-f9271cf78ab5 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] snapshot_file for this snap is: volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e7bab-43f4-4e00-af71-7d7057772ee0]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:29 devstack sudo[84723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f Apr 20 17:05:29 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:30 devstack sudo[84729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:30 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:30 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f" returned: 0 in 0.821s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f1fd7-d6af-4721-9a2e-5d8edba34b3c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:30 devstack sudo[84732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 Apr 20 17:05:30 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:05:30 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Flow 'volume_create_manager' (7caa2e85-2bca-42a2-affd-01b15494a84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb79684c-160f-4c83-b189-7a59b13cd9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.615s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb79684c-160f-4c83-b189-7a59b13cd9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1079986283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4120c9-a7ac-4607-98b1-11abb05da37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1270c59570c7492cb710cf2f04485b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:31Z,use_quota=True,user_id='35f7f11f0a08401d8516f0c3de2d611b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87e195b-9169-4d3b-8093-105649efd8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87e195b-9169-4d3b-8093-105649efd8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5190492f-4034-4acd-88f0-f30d9e8ce0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5190492f-4034-4acd-88f0-f30d9e8ce0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4120c9-a7ac-4607-98b1-11abb05da37e', 'volume_name': 'volume-dc4120c9-a7ac-4607-98b1-11abb05da37e', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf956eff-ecb1-428a-a375-9cd2e04ad909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf956eff-ecb1-428a-a375-9cd2e04ad909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6ffb65-7c97-4673-9bad-0415138bbab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:30 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Volume dc4120c9-a7ac-4607-98b1-11abb05da37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4120c9-a7ac-4607-98b1-11abb05da37e', 'volume_size': 1} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1079986283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4120c9-a7ac-4607-98b1-11abb05da37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1270c59570c7492cb710cf2f04485b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:31Z,use_quota=True,user_id='35f7f11f0a08401d8516f0c3de2d611b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Creating volume dc4120c9-a7ac-4607-98b1-11abb05da37e {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:05:30 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:30 devstack sudo[84735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e 1073741824 Apr 20 17:05:30 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:30 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" returned: 0 in 0.753s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:30 devstack sudo[84743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f Apr 20 17:05:30 devstack sudo[84743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:31 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e 1073741824" returned: 0 in 0.666s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:31 devstack sudo[84752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e Apr 20 17:05:31 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:31 devstack sudo[84743]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f" returned: 0 in 0.536s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:31 devstack sudo[84754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f Apr 20 17:05:31 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:31 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e" returned: 0 in 0.461s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6ffb65-7c97-4673-9bad-0415138bbab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4120c9-a7ac-4607-98b1-11abb05da37e', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87e8f67-c28a-4cc7-afce-333d47a8cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:31 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Volume volume-dc4120c9-a7ac-4607-98b1-11abb05da37e (dc4120c9-a7ac-4607-98b1-11abb05da37e): created successfully Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87e8f67-c28a-4cc7-afce-333d47a8cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Flow 'volume_create_manager' (7caa2e85-2bca-42a2-affd-01b15494a84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-81c3f3a0-c739-44e6-b2bc-02c035c710f6 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Created volume successfully. Apr 20 17:05:31 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5.a082de89-0d68-42de-b126-1f2425793c2f" returned: 0 in 0.428s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-quobyte-a082de89-0d68-42de-b126-1f2425793c2f" released by "_delete_snapshot" :: held 2.600s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-quobyte-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" released by "delete_snapshot" :: held 2.630s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:31 devstack cinder-volume[82240]: WARNING cinder.quota [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:05:31 devstack cinder-volume[82240]: DEBUG cinder.quota [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Created reservations ['4ad48762-91dd-471f-9832-32ed1cab7516', '1cdd58b7-6d81-45bc-a719-16c594a2e443', 'd8635b40-ddb4-4309-ac6b-d8bf989479a7', 'bf847623-b441-4b21-a457-ad164374f9b5'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:05:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Delete snapshot completed successfully. Apr 20 17:05:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-8e7e0899-1a6c-41ab-8c8c-09e3fc02cf8d req-59d698d7-9368-46b4-a5c2-c3a11f6419e2 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-a082de89-0d68-42de-b126-1f2425793c2f-delete_snapshot" released by "delete_snapshot" :: held 2.739s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "cinder-3ade9a28-0c44-46b9-ad87-f9271cf78ab5-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-3ade9a28-0c44-46b9-ad87-f9271cf78ab5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "cinder-quobyte-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-quobyte-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:32 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18403e7-4eef-40f6-b2c2-d6efdceff675]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:32 devstack sudo[84782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 Apr 20 17:05:32 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:33 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" returned: 0 in 0.805s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:33 devstack sudo[84791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5 Apr 20 17:05:33 devstack sudo[84791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Acquiring lock "cinder-dc4120c9-a7ac-4607-98b1-11abb05da37e-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "cinder-dc4120c9-a7ac-4607-98b1-11abb05da37e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Acquiring lock "cinder-quobyte-dc4120c9-a7ac-4607-98b1-11abb05da37e" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "cinder-quobyte-dc4120c9-a7ac-4607-98b1-11abb05da37e" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:33 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd084f74-7702-42c6-a5af-e0f1846907c2]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:33 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e Apr 20 17:05:33 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:34 devstack sudo[84791]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" returned: 0 in 0.515s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-quobyte-3ade9a28-0c44-46b9-ad87-f9271cf78ab5" released by "delete_volume" :: held 1.383s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG cinder.quota [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Created reservations ['cee033e1-3717-437b-9258-e6e778a7ac90', '313966dc-857c-445b-8d81-dad24c6dc5fe', '9811a46d-353f-4153-82a8-0a6fcab450fc', 'd846c40a-be1c-4bf9-bfb2-b67a4f860f83'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:34 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e" returned: 0 in 0.586s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:34 devstack sudo[84799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:34 devstack sudo[84799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:34 devstack sudo[84800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e Apr 20 17:05:34 devstack sudo[84800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.587s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG cinder.manager [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:34 devstack sudo[84799]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:34 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Deleted volume successfully. Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-190a8b1a-2b29-4b2a-b476-97485de33be0 req-fcdd57bf-69f9-435c-9e17-01f1074b2492 tempest-VolumesSnapshotsTestJSON-1535984636 None] Lock "cinder-3ade9a28-0c44-46b9-ad87-f9271cf78ab5-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:34 devstack sudo[84800]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc4120c9-a7ac-4607-98b1-11abb05da37e" returned: 0 in 0.638s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "cinder-quobyte-dc4120c9-a7ac-4607-98b1-11abb05da37e" released by "delete_volume" :: held 1.270s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Created reservations ['9b9cb8f3-aa95-41e6-9b1f-b5da12a45e96', '74c8df87-c15e-45d9-810e-2b03f8ddf254', '9f1d0665-bb85-4de7-aac6-d3886e96032f', '0afd8037-6c0f-4d65-8775-4f918a3fdc3b'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:35 devstack sudo[84805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:35 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:35 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.494s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:35 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Deleted volume successfully. Apr 20 17:05:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5d50d171-8c05-4f04-8f79-1393fb94f009 tempest-VolumeQuotasNegativeTestJSON-1642889556 None] Lock "cinder-dc4120c9-a7ac-4607-98b1-11abb05da37e-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Flow 'volume_create_manager' (030018db-e9d0-4af0-b613-124adc2f0505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1212c434-880c-4f4c-a8bb-2a1eb7d9b63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1212c434-880c-4f4c-a8bb-2a1eb7d9b63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1279550465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a552c500-83f3-41e9-9bc5-a9b96562638b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6137148b49d44c5eb9214228d5c11e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:38Z,use_quota=True,user_id='65e50a8fdf0349e49498488e51407fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6003c44e-1472-4782-94ef-2c39d80c4c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6003c44e-1472-4782-94ef-2c39d80c4c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5aa00a-3a3b-447f-bdc8-c2d4eb612d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5aa00a-3a3b-447f-bdc8-c2d4eb612d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a552c500-83f3-41e9-9bc5-a9b96562638b', 'volume_name': 'volume-a552c500-83f3-41e9-9bc5-a9b96562638b', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fe03c1-8159-41d9-8de6-6094808fe983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fe03c1-8159-41d9-8de6-6094808fe983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83302c96-383a-4f07-9e79-7daddfc91e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Volume a552c500-83f3-41e9-9bc5-a9b96562638b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a552c500-83f3-41e9-9bc5-a9b96562638b', 'volume_size': 1} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1279550465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a552c500-83f3-41e9-9bc5-a9b96562638b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6137148b49d44c5eb9214228d5c11e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:38Z,use_quota=True,user_id='65e50a8fdf0349e49498488e51407fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Creating volume a552c500-83f3-41e9-9bc5-a9b96562638b {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:05:38 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:05:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:38 devstack sudo[84840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b 1073741824 Apr 20 17:05:38 devstack sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:39 devstack sudo[84840]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b 1073741824" returned: 0 in 1.161s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:39 devstack sudo[84860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b Apr 20 17:05:39 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:39 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b" returned: 0 in 0.454s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:05:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83302c96-383a-4f07-9e79-7daddfc91e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a552c500-83f3-41e9-9bc5-a9b96562638b', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2258ba3e-bfd5-466f-87e4-6cba22869f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:40 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Volume volume-a552c500-83f3-41e9-9bc5-a9b96562638b (a552c500-83f3-41e9-9bc5-a9b96562638b): created successfully Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2258ba3e-bfd5-466f-87e4-6cba22869f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Flow 'volume_create_manager' (030018db-e9d0-4af0-b613-124adc2f0505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:40 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8edabf60-a46f-46b7-8bbf-f85e16733b3b tempest-VolumesTestJSON-170806628 None] Created volume successfully. Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Flow 'volume_create_manager' (8ead8ae5-0785-42ee-90eb-8453bae23983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f994ce2b-1a14-486c-89fb-2d83cdfd172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f994ce2b-1a14-486c-89fb-2d83cdfd172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1154726604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b49f00-2d7c-4b32-8e8f-6e6e449d328f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3944370dab8e44ad97a0b966004b9046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:41Z,use_quota=True,user_id='ba0c19dc74894a268afce7019bf6d8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be3870c-b6ab-4eb8-8915-43ca8f148487),volume_type_id=8be3870c-b6ab-4eb8-8915-43ca8f148487)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad5c8e3-4623-4ad7-9a9c-4acadeda6a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad5c8e3-4623-4ad7-9a9c-4acadeda6a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd494d1a-a1cc-46e8-b060-f21888ddc9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd494d1a-a1cc-46e8-b060-f21888ddc9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b49f00-2d7c-4b32-8e8f-6e6e449d328f', 'volume_name': 'volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82d7aa7-54cc-4da1-969d-9073bdddb4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82d7aa7-54cc-4da1-969d-9073bdddb4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f06ff7e-9439-44e4-91e1-4178f6832e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:40 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Volume d3b49f00-2d7c-4b32-8e8f-6e6e449d328f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f', 'volume_size': 1} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1154726604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b49f00-2d7c-4b32-8e8f-6e6e449d328f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3944370dab8e44ad97a0b966004b9046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:41Z,use_quota=True,user_id='ba0c19dc74894a268afce7019bf6d8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be3870c-b6ab-4eb8-8915-43ca8f148487),volume_type_id=8be3870c-b6ab-4eb8-8915-43ca8f148487)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Creating volume d3b49f00-2d7c-4b32-8e8f-6e6e449d328f {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:05:40 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:05:40 devstack sudo[84869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f 1073741824 Apr 20 17:05:40 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Flow 'volume_create_manager' (5fc02a1e-3aa8-4792-af65-0afe80e23b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08f3d9-7ba4-4259-8c32-6be3252458ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08f3d9-7ba4-4259-8c32-6be3252458ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1399566995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb71d6d-11eb-4915-a1ec-379987357305,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6137148b49d44c5eb9214228d5c11e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:41Z,use_quota=True,user_id='65e50a8fdf0349e49498488e51407fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ebb506-3f1a-4035-a3da-2f50faeed05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ebb506-3f1a-4035-a3da-2f50faeed05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfec8ad3-017e-45b6-86b1-a1c59a4dfc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfec8ad3-017e-45b6-86b1-a1c59a4dfc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb71d6d-11eb-4915-a1ec-379987357305', 'volume_name': 'volume-4cb71d6d-11eb-4915-a1ec-379987357305', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c84b79-d7c5-4ce9-b2e7-de20744d0136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c84b79-d7c5-4ce9-b2e7-de20744d0136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d858ffad-b28b-4421-aa8d-fbc6b9024d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:41 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Volume 4cb71d6d-11eb-4915-a1ec-379987357305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb71d6d-11eb-4915-a1ec-379987357305', 'volume_size': 1} Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:41 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f 1073741824" returned: 0 in 0.637s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:41 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f Apr 20 17:05:41 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:42 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f" returned: 0 in 0.492s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1399566995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb71d6d-11eb-4915-a1ec-379987357305,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6137148b49d44c5eb9214228d5c11e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:41Z,use_quota=True,user_id='65e50a8fdf0349e49498488e51407fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Creating volume 4cb71d6d-11eb-4915-a1ec-379987357305 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:05:42 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f06ff7e-9439-44e4-91e1-4178f6832e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3b3d25-9957-40d9-8f79-2672a9cc537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:42 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 1073741824 Apr 20 17:05:42 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:42 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Volume volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f (d3b49f00-2d7c-4b32-8e8f-6e6e449d328f): created successfully Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3b3d25-9957-40d9-8f79-2672a9cc537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Flow 'volume_create_manager' (8ead8ae5-0785-42ee-90eb-8453bae23983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:42 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c8d47825-a4f4-40b5-9c27-0489842ab8e3 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Created volume successfully. Apr 20 17:05:42 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 1073741824" returned: 0 in 0.521s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:42 devstack sudo[84900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 Apr 20 17:05:42 devstack sudo[84900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:43 devstack sudo[84900]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305" returned: 0 in 0.514s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:43 devstack sudo[84903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:43 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d858ffad-b28b-4421-aa8d-fbc6b9024d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb71d6d-11eb-4915-a1ec-379987357305', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6aa3e6f-f976-4756-b267-06b74e8ce700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:43 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Volume volume-4cb71d6d-11eb-4915-a1ec-379987357305 (4cb71d6d-11eb-4915-a1ec-379987357305): created successfully Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6aa3e6f-f976-4756-b267-06b74e8ce700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Flow 'volume_create_manager' (5fc02a1e-3aa8-4792-af65-0afe80e23b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-dddc1b2f-38fd-4149-ba68-dc7f22288a71 tempest-VolumesTestJSON-170806628 None] Created volume successfully. Apr 20 17:05:43 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.403s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:43 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b27783b9-5f3c-494a-b941-bae53edbfbeb tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Retype volume completed successfully. Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Flow 'volume_create_manager' (dd24ab7c-cd24-4fbf-ba94-2bfa304058d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70091a89-7aff-48bc-a8c1-b4f576410753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70091a89-7aff-48bc-a8c1-b4f576410753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-788485639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344ef34b-7650-423a-b133-3271f6be0240,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6137148b49d44c5eb9214228d5c11e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:45Z,use_quota=True,user_id='65e50a8fdf0349e49498488e51407fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389f0342-7aa1-43c0-9de0-64d172da1dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389f0342-7aa1-43c0-9de0-64d172da1dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f075b6c3-9a60-440e-90bb-14c7089ae015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f075b6c3-9a60-440e-90bb-14c7089ae015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344ef34b-7650-423a-b133-3271f6be0240', 'volume_name': 'volume-344ef34b-7650-423a-b133-3271f6be0240', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0fcf41-a62b-4308-94ff-c66dcfbed9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0fcf41-a62b-4308-94ff-c66dcfbed9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18686e7-1930-4096-aea0-03f3a87135e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:45 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Volume 344ef34b-7650-423a-b133-3271f6be0240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344ef34b-7650-423a-b133-3271f6be0240', 'volume_size': 1} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-788485639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344ef34b-7650-423a-b133-3271f6be0240,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6137148b49d44c5eb9214228d5c11e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:05:45Z,use_quota=True,user_id='65e50a8fdf0349e49498488e51407fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Creating volume 344ef34b-7650-423a-b133-3271f6be0240 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:05:45 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Acquiring lock "cinder-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "cinder-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Acquiring lock "cinder-quobyte-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:45 devstack sudo[84939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 1073741824 Apr 20 17:05:45 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "cinder-quobyte-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d1957-70bb-4970-b692-3bf86f47a52c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:45 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f Apr 20 17:05:45 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:45 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 1073741824" returned: 0 in 0.731s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:45 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 Apr 20 17:05:45 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:46 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f" returned: 0 in 0.942s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:46 devstack sudo[84976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f Apr 20 17:05:46 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:46 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240" returned: 0 in 0.587s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18686e7-1930-4096-aea0-03f3a87135e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344ef34b-7650-423a-b133-3271f6be0240', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107cbe35-1367-41c8-a670-8e83e0c10be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:05:46 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Volume volume-344ef34b-7650-423a-b133-3271f6be0240 (344ef34b-7650-423a-b133-3271f6be0240): created successfully Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107cbe35-1367-41c8-a670-8e83e0c10be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Flow 'volume_create_manager' (dd24ab7c-cd24-4fbf-ba94-2bfa304058d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:05:46 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-dba26a1d-ed0d-4556-be85-8b2f8bddc4ab tempest-VolumesTestJSON-170806628 None] Created volume successfully. Apr 20 17:05:46 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f" returned: 0 in 0.616s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "cinder-quobyte-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f" released by "delete_volume" :: held 1.643s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:46 devstack cinder-volume[82240]: WARNING cinder.quota [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:05:46 devstack cinder-volume[82240]: WARNING cinder.quota [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Created reservations ['cf6c08e7-4dc5-4c31-91f9-d18390544195', '2524560b-8a2c-4e7f-888d-36306117f0f0', '635cccfa-bc25-45aa-b50c-e0106c4711c6', 'a26277b5-f6aa-4602-9ef3-bb059e91c6b1'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:46 devstack sudo[85005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:46 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Acquiring lock "cinder-344ef34b-7650-423a-b133-3271f6be0240-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Lock "cinder-344ef34b-7650-423a-b133-3271f6be0240-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:48 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Acquiring lock "cinder-quobyte-344ef34b-7650-423a-b133-3271f6be0240" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 1.545s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:48 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Deleted volume successfully. Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Lock "cinder-quobyte-344ef34b-7650-423a-b133-3271f6be0240" acquired by "delete_volume" :: waited 0.039s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a0f35fb6-f947-455c-aab5-0fce3c675278 tempest-VolumeRetypeWithoutMigrationTest-57664214 None] Lock "cinder-d3b49f00-2d7c-4b32-8e8f-6e6e449d328f-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bffff7a-7497-4705-a7af-f08aa8400122]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:48 devstack sudo[85010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 Apr 20 17:05:48 devstack sudo[85010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:49 devstack sudo[85010]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240" returned: 0 in 1.100s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:49 devstack sudo[85039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240 Apr 20 17:05:49 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:50 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-344ef34b-7650-423a-b133-3271f6be0240" returned: 0 in 0.794s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Lock "cinder-quobyte-344ef34b-7650-423a-b133-3271f6be0240" released by "delete_volume" :: held 1.987s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Created reservations ['617d9436-15a2-404a-932b-2a1b73103dd1', 'd3e3b6ff-da77-478c-91fd-6c5a7e053f26', '1f597020-5f26-4da7-b178-d07b77e595c7', '35aeea7a-831d-4af5-80c5-cea77036cb4a'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:50 devstack sudo[85065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:50 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:51 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.669s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:51 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Deleted volume successfully. Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bd922711-3625-406e-a3d3-2aacaef5802c tempest-VolumesTestJSON-170806628 None] Lock "cinder-344ef34b-7650-423a-b133-3271f6be0240-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Acquiring lock "cinder-4cb71d6d-11eb-4915-a1ec-379987357305-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Lock "cinder-4cb71d6d-11eb-4915-a1ec-379987357305-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Acquiring lock "cinder-quobyte-4cb71d6d-11eb-4915-a1ec-379987357305" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Lock "cinder-quobyte-4cb71d6d-11eb-4915-a1ec-379987357305" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c058f-945c-4e11-a7b2-d8d9ac23298f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:51 devstack sudo[85071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 Apr 20 17:05:51 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:52 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305" returned: 0 in 0.706s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:52 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305 Apr 20 17:05:52 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:53 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4cb71d6d-11eb-4915-a1ec-379987357305" returned: 0 in 0.925s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Lock "cinder-quobyte-4cb71d6d-11eb-4915-a1ec-379987357305" released by "delete_volume" :: held 1.681s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Created reservations ['72188b3a-1e08-495a-83e3-e1b895caa397', 'd68707c1-fc8d-49da-8acb-aea206bea848', 'b83884e9-b238-45a5-bdba-591e856fbab8', '16574c83-6689-4458-95b9-90d775511127'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:53 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:53 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Acquiring lock "cinder-a552c500-83f3-41e9-9bc5-a9b96562638b-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Lock "cinder-a552c500-83f3-41e9-9bc5-a9b96562638b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Acquiring lock "cinder-quobyte-a552c500-83f3-41e9-9bc5-a9b96562638b" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Lock "cinder-quobyte-a552c500-83f3-41e9-9bc5-a9b96562638b" acquired by "delete_volume" :: waited 0.026s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:05:54 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.660s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca3bf7c-b1e2-4287-be8b-2ab15c6cc40b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:54 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Deleted volume successfully. Apr 20 17:05:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3b762fc9-dd82-45e1-a81e-f93c963c39d9 tempest-VolumesTestJSON-170806628 None] Lock "cinder-4cb71d6d-11eb-4915-a1ec-379987357305-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:54 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b Apr 20 17:05:54 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:55 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b" returned: 0 in 0.832s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:55 devstack sudo[85121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b Apr 20 17:05:55 devstack sudo[85121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:55 devstack sudo[85121]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a552c500-83f3-41e9-9bc5-a9b96562638b" returned: 0 in 0.573s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Lock "cinder-quobyte-a552c500-83f3-41e9-9bc5-a9b96562638b" released by "delete_volume" :: held 1.444s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Created reservations ['23abeafd-8119-453a-b4a8-ac1cb7a0da3f', 'f42b0547-89b2-467b-b2fd-6812167b1108', 'aa0c54c6-5d82-411b-8a77-0d1d2501d7a5', '1b217f59-cbc1-4bd8-914f-dc5922036730'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:05:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:05:55 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:05:55 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:05:56 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 20 17:05:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.475s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:05:56 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:05:56 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Deleted volume successfully. Apr 20 17:05:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-112f1086-13a1-4546-981d-010f30bd8973 tempest-VolumesTestJSON-170806628 None] Lock "cinder-a552c500-83f3-41e9-9bc5-a9b96562638b-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:05:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d2a7133e-8677-4382-babc-00abaef24efa tempest-BackendsCapabilitiesAdminTestsJSON-1605930546 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82240) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-afad2279-b514-416f-bc62-b64406865fc2 tempest-BackendsCapabilitiesAdminTestsJSON-1605930546 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82240) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Flow 'volume_create_manager' (a553e9bf-ee63-4b0d-96dd-3c64a2958acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066ae844-2295-442a-86d2-c37bd670cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066ae844-2295-442a-86d2-c37bd670cfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1079384857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f25955-73c9-4aa1-8179-5932b8731c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d34f219f72e4323a2e33f5ada3c36b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:01Z,use_quota=True,user_id='ed37e7618b244166ba24b3db73df4b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2a8eb1-9231-4bfc-a1b9-c64330af57ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2a8eb1-9231-4bfc-a1b9-c64330af57ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dfefd8-d3fc-444d-a3d6-07e40804a753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dfefd8-d3fc-444d-a3d6-07e40804a753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2f25955-73c9-4aa1-8179-5932b8731c18', 'volume_name': 'volume-c2f25955-73c9-4aa1-8179-5932b8731c18', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700309f3-cb6a-4d04-b7ec-21692e1e70ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700309f3-cb6a-4d04-b7ec-21692e1e70ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07813875-f9c9-45e1-be36-b697a7e29626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:00 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Volume c2f25955-73c9-4aa1-8179-5932b8731c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2f25955-73c9-4aa1-8179-5932b8731c18', 'volume_size': 1} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1079384857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f25955-73c9-4aa1-8179-5932b8731c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d34f219f72e4323a2e33f5ada3c36b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:01Z,use_quota=True,user_id='ed37e7618b244166ba24b3db73df4b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Creating volume c2f25955-73c9-4aa1-8179-5932b8731c18 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:00 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:00 devstack sudo[85171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 1073741824 Apr 20 17:06:00 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:01 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 1073741824" returned: 0 in 0.612s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:01 devstack sudo[85176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 Apr 20 17:06:01 devstack sudo[85176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:02 devstack sudo[85176]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18" returned: 0 in 0.607s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07813875-f9c9-45e1-be36-b697a7e29626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f25955-73c9-4aa1-8179-5932b8731c18', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a084352-ddf3-4b6c-acc2-a2f865bdf33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:02 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Volume volume-c2f25955-73c9-4aa1-8179-5932b8731c18 (c2f25955-73c9-4aa1-8179-5932b8731c18): created successfully Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a084352-ddf3-4b6c-acc2-a2f865bdf33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Flow 'volume_create_manager' (a553e9bf-ee63-4b0d-96dd-3c64a2958acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:02 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-18875b50-8480-4003-aa97-faf3acb95e5b tempest-ServersNegativeTestJSON-1023598591 None] Created volume successfully. Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Flow 'volume_create_manager' (35f3a4f9-04cf-4d83-be3c-b59a693aad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001e9195-8f78-4a4f-88d2-98804d07be1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001e9195-8f78-4a4f-88d2-98804d07be1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1992349223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eee725-cbb3-4ac2-a5de-f9e90239dfa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52171960388a44139cb886266102b182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:02Z,use_quota=True,user_id='670f2e2c637d4d7199c478a94dbef6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41405b0-1b33-484e-aa70-2e9dd1dd50fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41405b0-1b33-484e-aa70-2e9dd1dd50fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e158bd5-32d9-4fa8-b1bd-ad7fc0d75fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e158bd5-32d9-4fa8-b1bd-ad7fc0d75fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5eee725-cbb3-4ac2-a5de-f9e90239dfa0', 'volume_name': 'volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7224d5-8ef8-4f7b-8ae1-fc99ffae6028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7224d5-8ef8-4f7b-8ae1-fc99ffae6028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f991b61-09c8-4af1-a1cc-2e46bfe6d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:02 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Volume b5eee725-cbb3-4ac2-a5de-f9e90239dfa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0', 'volume_size': 1} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1992349223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eee725-cbb3-4ac2-a5de-f9e90239dfa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52171960388a44139cb886266102b182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:02Z,use_quota=True,user_id='670f2e2c637d4d7199c478a94dbef6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Creating volume b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:02 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:02 devstack sudo[85179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 1073741824 Apr 20 17:06:02 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:03 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 1073741824" returned: 0 in 0.668s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:03 devstack sudo[85184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 Apr 20 17:06:03 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:03 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0" returned: 0 in 0.672s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f991b61-09c8-4af1-a1cc-2e46bfe6d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f6a51c-0937-4129-a26e-e99fe8b51faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:03 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Volume volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 (b5eee725-cbb3-4ac2-a5de-f9e90239dfa0): created successfully Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f6a51c-0937-4129-a26e-e99fe8b51faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Flow 'volume_create_manager' (35f3a4f9-04cf-4d83-be3c-b59a693aad32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Flow 'volume_create_manager' (794fc993-8e8b-4438-b4e4-38b0ec632153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751085b3-49ff-4177-84e1-67ce9412185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-21b44692-6f6d-48f5-8cd3-8c2eb5507c0f tempest-VolumesListAdminTestJSON-259784873 None] Created volume successfully. Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751085b3-49ff-4177-84e1-67ce9412185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1181960298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63100bee-d4f7-464e-8f4e-ab4349f92fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d34f219f72e4323a2e33f5ada3c36b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:04Z,use_quota=True,user_id='ed37e7618b244166ba24b3db73df4b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6de3ec-6989-4c09-a555-bbddc1f6068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6de3ec-6989-4c09-a555-bbddc1f6068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c407aaab-928c-4a5b-9a99-35d6a6286e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c407aaab-928c-4a5b-9a99-35d6a6286e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63100bee-d4f7-464e-8f4e-ab4349f92fea', 'volume_name': 'volume-63100bee-d4f7-464e-8f4e-ab4349f92fea', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93659942-815b-44a0-b9c1-28c1d11558b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93659942-815b-44a0-b9c1-28c1d11558b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac7f42d-7772-43f3-924b-892326b789bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Volume 63100bee-d4f7-464e-8f4e-ab4349f92fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63100bee-d4f7-464e-8f4e-ab4349f92fea', 'volume_size': 1} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1181960298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63100bee-d4f7-464e-8f4e-ab4349f92fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d34f219f72e4323a2e33f5ada3c36b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:04Z,use_quota=True,user_id='ed37e7618b244166ba24b3db73df4b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Creating volume 63100bee-d4f7-464e-8f4e-ab4349f92fea {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:04 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:04 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea 1073741824 Apr 20 17:06:04 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:04 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea 1073741824" returned: 0 in 0.607s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:04 devstack sudo[85195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea Apr 20 17:06:04 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c1b06755-6629-418a-9241-e462f5eda5f3 tempest-GroupSnapshotsV319Test-227570946 None] Group tempest-GroupSnapshotsV319Test-Group-2137681925: creating Apr 20 17:06:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c1b06755-6629-418a-9241-e462f5eda5f3 tempest-GroupSnapshotsV319Test-227570946 None] Group tempest-GroupSnapshotsV319Test-Group-2137681925: created successfully Apr 20 17:06:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c1b06755-6629-418a-9241-e462f5eda5f3 tempest-GroupSnapshotsV319Test-227570946 None] Create group completed successfully. Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Flow 'volume_create_manager' (4010ff09-b3fb-44fe-a0cb-723fe922cd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea67ba7-55b6-4c1e-b4aa-bfc3963b8746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea67ba7-55b6-4c1e-b4aa-bfc3963b8746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2118141568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e6f664-8de6-4a2e-9148-057e18610f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52171960388a44139cb886266102b182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:05Z,use_quota=True,user_id='670f2e2c637d4d7199c478a94dbef6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758791ff-146c-4f53-ad62-af7035aaeb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758791ff-146c-4f53-ad62-af7035aaeb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2aac63-cecf-4be6-bd24-fa3975abb3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2aac63-cecf-4be6-bd24-fa3975abb3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e6f664-8de6-4a2e-9148-057e18610f3a', 'volume_name': 'volume-96e6f664-8de6-4a2e-9148-057e18610f3a', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45f6b31-f0c4-4bd2-acaa-401bfc697d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45f6b31-f0c4-4bd2-acaa-401bfc697d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ba8520-81ed-4735-a7c2-c5697c9fd131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:04 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Volume 96e6f664-8de6-4a2e-9148-057e18610f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e6f664-8de6-4a2e-9148-057e18610f3a', 'volume_size': 1} Apr 20 17:06:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:05 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea" returned: 0 in 0.830s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2118141568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e6f664-8de6-4a2e-9148-057e18610f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52171960388a44139cb886266102b182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:05Z,use_quota=True,user_id='670f2e2c637d4d7199c478a94dbef6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Creating volume 96e6f664-8de6-4a2e-9148-057e18610f3a {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:05 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac7f42d-7772-43f3-924b-892326b789bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63100bee-d4f7-464e-8f4e-ab4349f92fea', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e04ba2-bb46-44f2-84eb-33c464264e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:05 devstack sudo[85232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a 1073741824 Apr 20 17:06:05 devstack sudo[85232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:05 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Volume volume-63100bee-d4f7-464e-8f4e-ab4349f92fea (63100bee-d4f7-464e-8f4e-ab4349f92fea): created successfully Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e04ba2-bb46-44f2-84eb-33c464264e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Flow 'volume_create_manager' (794fc993-8e8b-4438-b4e4-38b0ec632153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:05 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-31046b97-8fa4-49dd-b59a-a72d72d1a41d tempest-ServersNegativeTestJSON-1023598591 None] Created volume successfully. Apr 20 17:06:06 devstack sudo[85232]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a 1073741824" returned: 0 in 0.607s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:06 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a Apr 20 17:06:06 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Flow 'volume_create_manager' (37099db5-2197-47ee-b4de-47ffc606093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de700e6-faaf-45c5-887e-9c28654a8c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de700e6-faaf-45c5-887e-9c28654a8c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1867581332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c493531d-a548-4fd6-adef-fd93b774391a,host='devstack@QuobyteHD#QuobyteHD',id=ee3fad2d-0d08-4d12-b8db-949e47a3b29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1e0f04871c4dd9b3d6e878dee026e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:06Z,use_quota=True,user_id='f23a46545cb5452c873bfa100fc12858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6cddf4-1739-4be2-9d71-3eb51a2480e5),volume_type_id=9e6cddf4-1739-4be2-9d71-3eb51a2480e5)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52eab07-7d63-4f4f-92e3-24489fc7386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52eab07-7d63-4f4f-92e3-24489fc7386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b4567c-e612-4954-a961-c0e7cb778d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b4567c-e612-4954-a961-c0e7cb778d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3fad2d-0d08-4d12-b8db-949e47a3b29c', 'volume_name': 'volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e334f013-ca19-4df7-83c0-069f40673e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e334f013-ca19-4df7-83c0-069f40673e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa20c065-4212-4ca6-bf12-2c37a196c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Volume ee3fad2d-0d08-4d12-b8db-949e47a3b29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c', 'volume_size': 1} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:06 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a" returned: 0 in 0.774s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c493531d-a548-4fd6-adef-fd93b774391a,created_at=2026-04-20T15:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1867581332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c493531d-a548-4fd6-adef-fd93b774391a,host='devstack@QuobyteHD#QuobyteHD',id=ee3fad2d-0d08-4d12-b8db-949e47a3b29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1e0f04871c4dd9b3d6e878dee026e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:06Z,use_quota=True,user_id='f23a46545cb5452c873bfa100fc12858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6cddf4-1739-4be2-9d71-3eb51a2480e5),volume_type_id=9e6cddf4-1739-4be2-9d71-3eb51a2480e5)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Creating volume ee3fad2d-0d08-4d12-b8db-949e47a3b29c {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:06 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "cinder-63100bee-d4f7-464e-8f4e-ab4349f92fea-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ba8520-81ed-4735-a7c2-c5697c9fd131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e6f664-8de6-4a2e-9148-057e18610f3a', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:07 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c 1073741824 Apr 20 17:06:07 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1b8769-c07d-45b8-aeb6-f1c7732ea135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Lock "cinder-63100bee-d4f7-464e-8f4e-ab4349f92fea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:07 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Volume volume-96e6f664-8de6-4a2e-9148-057e18610f3a (96e6f664-8de6-4a2e-9148-057e18610f3a): created successfully Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1b8769-c07d-45b8-aeb6-f1c7732ea135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Flow 'volume_create_manager' (4010ff09-b3fb-44fe-a0cb-723fe922cd15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "cinder-quobyte-63100bee-d4f7-464e-8f4e-ab4349f92fea" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8e0fe8fc-36de-4a2d-aaff-490bb5ff485f tempest-VolumesListAdminTestJSON-259784873 None] Created volume successfully. Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Lock "cinder-quobyte-63100bee-d4f7-464e-8f4e-ab4349f92fea" acquired by "delete_volume" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe1fa69-cbf4-497c-ba0d-24c8de6eb655]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:07 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea Apr 20 17:06:07 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:07 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c 1073741824" returned: 0 in 0.650s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:07 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:07 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c Apr 20 17:06:07 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:07 devstack sudo[85256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea Apr 20 17:06:07 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:08 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" returned: 0 in 0.425s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa20c065-4212-4ca6-bf12-2c37a196c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0ac1c5-2cff-4b0a-b91b-995f92ec6cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:08 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Volume volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c (ee3fad2d-0d08-4d12-b8db-949e47a3b29c): created successfully Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0ac1c5-2cff-4b0a-b91b-995f92ec6cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Flow 'volume_create_manager' (37099db5-2197-47ee-b4de-47ffc606093b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:08 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-cf25a2aa-253c-4e90-bffc-d21526a2dd5a tempest-GroupSnapshotsV319Test-227570946 None] Created volume successfully. Apr 20 17:06:08 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-63100bee-d4f7-464e-8f4e-ab4349f92fea" returned: 0 in 0.588s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Lock "cinder-quobyte-63100bee-d4f7-464e-8f4e-ab4349f92fea" released by "delete_volume" :: held 1.184s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Created reservations ['4ad73ca0-9564-416a-95a2-f36b031ce6f5', 'a1fd356a-fbfa-499c-82a4-ae4a20e6c4f3', 'cfe5ed6f-f5b9-4133-a393-d012baa35764', 'c6a601e8-8960-45c3-b0fe-455bffbddf54'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:08 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:08 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Flow 'volume_create_manager' (3fdfd66d-8a43-4d79-b56d-2e46a92e5023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3580fd93-ed58-4275-81fc-bcd16e71a63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3580fd93-ed58-4275-81fc-bcd16e71a63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-711734657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c926ed-f409-433a-a6c5-06298139cbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52171960388a44139cb886266102b182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:09Z,use_quota=True,user_id='670f2e2c637d4d7199c478a94dbef6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17b1835-0495-424e-af3b-82b0361d12fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17b1835-0495-424e-af3b-82b0361d12fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb15e93-c66d-47b7-a574-5640bc5f3d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb15e93-c66d-47b7-a574-5640bc5f3d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c926ed-f409-433a-a6c5-06298139cbad', 'volume_name': 'volume-74c926ed-f409-433a-a6c5-06298139cbad', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fba9a61-c4d8-4beb-b3a0-a6ceb39029a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fba9a61-c4d8-4beb-b3a0-a6ceb39029a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601f6c64-8a62-404e-99e4-e560ec06f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:08 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Volume 74c926ed-f409-433a-a6c5-06298139cbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c926ed-f409-433a-a6c5-06298139cbad', 'volume_size': 1} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-711734657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c926ed-f409-433a-a6c5-06298139cbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52171960388a44139cb886266102b182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:09Z,use_quota=True,user_id='670f2e2c637d4d7199c478a94dbef6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Creating volume 74c926ed-f409-433a-a6c5-06298139cbad {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:08 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:08 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] GroupSnapshot 81615ccd-ed4b-4d3d-8567-764ee75fbd65: creating. Apr 20 17:06:08 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad 1073741824 Apr 20 17:06:08 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Group snapshot 81615ccd-ed4b-4d3d-8567-764ee75fbd65: creating. {{(pid=82240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 20 17:06:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:09 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.649s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Deleted volume successfully. Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8524a8c3-6151-48a7-b97c-4993835a585e tempest-ServersNegativeTestJSON-1023598591 None] Lock "cinder-63100bee-d4f7-464e-8f4e-ab4349f92fea-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "cinder-c2f25955-73c9-4aa1-8179-5932b8731c18-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Lock "cinder-c2f25955-73c9-4aa1-8179-5932b8731c18-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "cinder-quobyte-c2f25955-73c9-4aa1-8179-5932b8731c18" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Lock "cinder-quobyte-c2f25955-73c9-4aa1-8179-5932b8731c18" acquired by "delete_volume" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfefb8b-cb81-4bf3-9924-c7588388b129]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:09 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad 1073741824" returned: 0 in 0.630s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:09 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 Apr 20 17:06:09 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:09 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad Apr 20 17:06:09 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:09 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad" returned: 0 in 0.450s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.052s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=93,cinder:UPDATE=114,cinder:DELETE=15,cinder:INSERT=27 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Creating offline snapshot 97790397-3c10-4826-afd6-c1ab1b2f27ad of volume ee3fad2d-0d08-4d12-b8db-949e47a3b29c {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601f6c64-8a62-404e-99e4-e560ec06f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c926ed-f409-433a-a6c5-06298139cbad', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b826ff52-1217-4242-9e20-02312adcd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[971c837d-8ffd-4775-bcf1-305e2de91201]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:09 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:09 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Volume volume-74c926ed-f409-433a-a6c5-06298139cbad (74c926ed-f409-433a-a6c5-06298139cbad): created successfully Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b826ff52-1217-4242-9e20-02312adcd754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Flow 'volume_create_manager' (3fdfd66d-8a43-4d79-b56d-2e46a92e5023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18" returned: 0 in 0.586s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-987b9357-7ffe-470a-a570-c02cf10e73f8 tempest-VolumesListAdminTestJSON-259784873 None] Created volume successfully. Apr 20 17:06:09 devstack sudo[85278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18 Apr 20 17:06:09 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:09 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c Apr 20 17:06:09 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:10 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c2f25955-73c9-4aa1-8179-5932b8731c18" returned: 0 in 0.444s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Lock "cinder-quobyte-c2f25955-73c9-4aa1-8179-5932b8731c18" released by "delete_volume" :: held 1.062s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Created reservations ['08b3c982-e6fd-4508-af53-44def0538f6d', '094eec4c-a0ea-495f-9f90-d49a26d53e4f', 'ab66a847-3ab1-4936-b62a-338aa811669a', '4a85284d-ae91-454b-a825-65c5f73e44f3'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:10 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" returned: 0 in 0.581s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:10 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:10 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:10 devstack sudo[85287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad 1G Apr 20 17:06:10 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:10 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:10 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:10 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Deleted volume successfully. Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b8283a55-d8a2-4f11-a49c-86933fe5df78 tempest-ServersNegativeTestJSON-1023598591 None] Lock "cinder-c2f25955-73c9-4aa1-8179-5932b8731c18-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:11 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad 1G" returned: 0 in 0.631s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:11 devstack sudo[85293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad Apr 20 17:06:11 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Flow 'volume_create_manager' (1d55089d-0a68-40d6-a542-d2925d04b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa8b0e3-718e-408c-85ed-565a3ea54f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa8b0e3-718e-408c-85ed-565a3ea54f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1db643d-96a8-48e7-933b-f0362282e16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc0a164284b4945be2aafe18cbd0aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:11Z,use_quota=True,user_id='b8ea217ea2c243289e755170c8171217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367cf43b-d6ed-4c9f-9d05-5a1b2345420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367cf43b-d6ed-4c9f-9d05-5a1b2345420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce382103-efb0-45fc-a6da-566d98285713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce382103-efb0-45fc-a6da-566d98285713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1db643d-96a8-48e7-933b-f0362282e16b', 'volume_name': 'volume-c1db643d-96a8-48e7-933b-f0362282e16b', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0117c71b-5c2e-4038-a547-f7ad7b2e8359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0117c71b-5c2e-4038-a547-f7ad7b2e8359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a24a3bc-d43e-48a1-b957-8b4986f38357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:11 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Volume c1db643d-96a8-48e7-933b-f0362282e16b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1db643d-96a8-48e7-933b-f0362282e16b', 'volume_size': 1} Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:11 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad" returned: 0 in 0.548s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:11 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:06:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:11 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad Apr 20 17:06:11 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:12 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:12 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.info Apr 20 17:06:12 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:12 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.info" returned: 0 in 0.440s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:12 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:06:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:12 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.info Apr 20 17:06:12 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:13 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.info" returned: 0 in 0.659s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.417s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1db643d-96a8-48e7-933b-f0362282e16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc0a164284b4945be2aafe18cbd0aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:11Z,use_quota=True,user_id='b8ea217ea2c243289e755170c8171217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Creating volume c1db643d-96a8-48e7-933b-f0362282e16b {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:13 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:13 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b 1073741824 Apr 20 17:06:13 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:13 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a70dc5c3-2cff-4d21-a558-24c4ed568f0d tempest-GroupSnapshotsV319Test-227570946 None] group_snapshot 81615ccd-ed4b-4d3d-8567-764ee75fbd65: created successfully Apr 20 17:06:13 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b 1073741824" returned: 0 in 0.625s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:14 devstack sudo[85400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b Apr 20 17:06:14 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] group_snapshot 81615ccd-ed4b-4d3d-8567-764ee75fbd65: deleting Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] group_snapshot 81615ccd-ed4b-4d3d-8567-764ee75fbd65: deleting {{(pid=82240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Acquiring lock "cinder-quobyte-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Lock "cinder-quobyte-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Acquiring lock "cinder-quobyte-97790397-3c10-4826-afd6-c1ab1b2f27ad" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Lock "cinder-quobyte-97790397-3c10-4826-afd6-c1ab1b2f27ad" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Deleting offline snapshot 97790397-3c10-4826-afd6-c1ab1b2f27ad of volume ee3fad2d-0d08-4d12-b8db-949e47a3b29c {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] snapshot_file for this snap is: volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ee0109-c396-4de5-821c-399c5250e4b5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:14 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad Apr 20 17:06:14 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:14 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b" returned: 0 in 0.966s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a24a3bc-d43e-48a1-b957-8b4986f38357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1db643d-96a8-48e7-933b-f0362282e16b', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a167bc8f-d8b6-4edc-8eb3-ffaf5ad13bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:14 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Volume volume-c1db643d-96a8-48e7-933b-f0362282e16b (c1db643d-96a8-48e7-933b-f0362282e16b): created successfully Apr 20 17:06:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a167bc8f-d8b6-4edc-8eb3-ffaf5ad13bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Flow 'volume_create_manager' (1d55089d-0a68-40d6-a542-d2925d04b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:15 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-cf7e77c5-c1a2-4513-a5d6-22207cd4633d tempest-VolumesListAdminTestJSON-1905814771 None] Created volume successfully. Apr 20 17:06:15 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad" returned: 0 in 0.545s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7acedc4-12f8-4a37-a593-f7790473cbf2]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:15 devstack sudo[85410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c Apr 20 17:06:15 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Acquiring lock "cinder-c1db643d-96a8-48e7-933b-f0362282e16b-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Lock "cinder-c1db643d-96a8-48e7-933b-f0362282e16b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Acquiring lock "cinder-quobyte-c1db643d-96a8-48e7-933b-f0362282e16b" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Lock "cinder-quobyte-c1db643d-96a8-48e7-933b-f0362282e16b" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf74346-eb30-4dbf-b412-0aad79d27da3]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "cinder-74c926ed-f409-433a-a6c5-06298139cbad-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:15 devstack sudo[85412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b Apr 20 17:06:15 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-74c926ed-f409-433a-a6c5-06298139cbad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "cinder-quobyte-74c926ed-f409-433a-a6c5-06298139cbad" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-quobyte-74c926ed-f409-433a-a6c5-06298139cbad" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[11447428-152f-40f8-bc0c-a640b4b64dd8]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:15 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" returned: 0 in 0.670s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:15 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad Apr 20 17:06:15 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:16 devstack sudo[85417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad Apr 20 17:06:16 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:16 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b" returned: 0 in 0.774s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:16 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b Apr 20 17:06:16 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:16 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad" returned: 0 in 0.824s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:16 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad" returned: 0 in 0.857s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:16 devstack sudo[85436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad Apr 20 17:06:16 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:16 devstack sudo[85437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad Apr 20 17:06:16 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:16 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c1db643d-96a8-48e7-933b-f0362282e16b" returned: 0 in 0.517s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Lock "cinder-quobyte-c1db643d-96a8-48e7-933b-f0362282e16b" released by "delete_volume" :: held 1.324s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Created reservations ['2e93040d-9282-4fe5-86d1-4381dd3e5848', 'f37bcbb6-09b3-454e-a458-1e2b67cec32b', '6042b0a2-8a2c-4205-bcfe-ab8eb88437f3', '3ef5d28f-287a-455f-aaf5-56f4e6b7310f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:17 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:17 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:17 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74c926ed-f409-433a-a6c5-06298139cbad" returned: 0 in 0.612s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-quobyte-74c926ed-f409-433a-a6c5-06298139cbad" released by "delete_volume" :: held 1.508s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:17 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c.97790397-3c10-4826-afd6-c1ab1b2f27ad" returned: 0 in 0.670s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Created reservations ['8ddf4cf3-852a-4737-8850-7d18e0ea4ca8', '241aef79-1586-4dfb-9e70-6f9f538c1a41', '372e7549-2f41-4064-9669-d870bf88c745', 'b04ac907-7345-4a37-a4a3-4592cdc628b1'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Lock "cinder-quobyte-97790397-3c10-4826-afd6-c1ab1b2f27ad" released by "_delete_snapshot" :: held 2.834s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Lock "cinder-quobyte-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" released by "delete_snapshot" :: held 2.863s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:17 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:17 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:17 devstack cinder-volume[82240]: WARNING cinder.quota [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-208008975 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-208008975, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:06:17 devstack cinder-volume[82240]: WARNING cinder.quota [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-208008975 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-208008975, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] Created reservations ['cd679293-b997-4f45-b0b4-0231ebe83f28', '010d0567-98c5-44a7-a660-52bbc34eba34', '553070e9-3a7d-45b0-b4d3-dacefd55b066', 'c770a73e-9de4-488c-96da-9bdcdbb40661'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:17 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.566s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:17 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Deleted volume successfully. Apr 20 17:06:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-27604d35-b4de-4379-87ed-6ff073248520 tempest-VolumesListAdminTestJSON-1905814771 None] Lock "cinder-c1db643d-96a8-48e7-933b-f0362282e16b-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:17 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8c440424-4bb8-4be5-9a2c-9919a921340c tempest-GroupSnapshotsV319Test-227570946 None] group_snapshot 81615ccd-ed4b-4d3d-8567-764ee75fbd65: deleted successfully Apr 20 17:06:18 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.486s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:18 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Deleted volume successfully. Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-476ca24e-4362-41f8-8dcf-71d8983fa872 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-74c926ed-f409-433a-a6c5-06298139cbad-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Acquiring lock "cinder-quobyte-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Lock "cinder-quobyte-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4440e1-561c-4cf7-9e8b-b994dd86612e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "cinder-96e6f664-8de6-4a2e-9148-057e18610f3a-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-96e6f664-8de6-4a2e-9148-057e18610f3a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "cinder-quobyte-96e6f664-8de6-4a2e-9148-057e18610f3a" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-quobyte-96e6f664-8de6-4a2e-9148-057e18610f3a" acquired by "delete_volume" :: waited 0.020s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:18 devstack sudo[85451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c Apr 20 17:06:18 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c7069-7d6f-4489-b728-338055422a83]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:18 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a Apr 20 17:06:18 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:18 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" returned: 0 in 0.662s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:18 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c Apr 20 17:06:18 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:18 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a" returned: 0 in 0.634s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:18 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a Apr 20 17:06:18 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:19 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" returned: 0 in 0.562s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Lock "cinder-quobyte-ee3fad2d-0d08-4d12-b8db-949e47a3b29c" released by "delete_volume" :: held 1.282s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Created reservations ['31b58984-24f8-46c3-b11f-55817fbe334c'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:19 devstack cinder-volume[82240]: WARNING cinder.quota [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-208008975 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-208008975, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Created reservations ['540c86e5-871c-4526-81a9-7f77f5abd4f6', 'cb2a649c-22fc-4bd7-9e19-6fc76d687cb7', 'f83c69cf-16db-4dc5-961f-da1eb9b4d09b', 'e275354d-f7be-4c07-87fb-fe8db97c51a7'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:19 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-96e6f664-8de6-4a2e-9148-057e18610f3a" returned: 0 in 0.668s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-quobyte-96e6f664-8de6-4a2e-9148-057e18610f3a" released by "delete_volume" :: held 1.328s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:19 devstack sudo[85468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:19 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Created reservations ['a674dc84-8c2c-4e9d-965a-d3bdd25a9970', '1d32f137-9ea3-42c7-99d7-45cbab1ae761', '88e0e686-1b86-46be-afe4-b37b282860ee', '5bb44a84-1f02-4edd-9160-d4bae5b0a76e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:19 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:19 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:20 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-218d1832-5b72-4e81-9d1a-4e365f269427 tempest-GroupSnapshotsV319Test-227570946 None] Delete group completed successfully. Apr 20 17:06:20 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.534s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Deleted volume successfully. Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-95146511-0029-415e-814d-a5ad48e368b8 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-96e6f664-8de6-4a2e-9148-057e18610f3a-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "cinder-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "cinder-quobyte-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-quobyte-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0" acquired by "delete_volume" :: waited 0.021s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[22129a24-bf39-458e-8375-a3e12bf56e75]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:20 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 Apr 20 17:06:20 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:21 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0" returned: 0 in 0.807s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:21 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0 Apr 20 17:06:21 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:22 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0" returned: 0 in 0.785s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-quobyte-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0" released by "delete_volume" :: held 1.626s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=156,cinder:SELECT=119,cinder:INSERT=30,cinder:DELETE=9 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Created reservations ['c186d5e3-843d-4e84-be5c-4f989fffbac8', '015a18ae-04e6-4c6a-aca6-9ab28bcf0cd3', '4196d118-f657-438d-9dfe-c4922db23c4f', '08b3bc59-e3be-48b2-87f1-d5c28dfca4bb'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:22 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:22 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Flow 'volume_create_manager' (50dd16b5-476f-42e4-abf0-7843624157f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1928f67-7ed3-473d-bc65-cf4c0f31fd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1928f67-7ed3-473d-bc65-cf4c0f31fd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805eecd4-a975-4fab-b12a-691c655ddcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a06b529e814daead58465e085916dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:23Z,use_quota=True,user_id='142abd77d1e64600b76c5162dcf0811e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae721bf-2d04-4edc-9bc3-ff8535808e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae721bf-2d04-4edc-9bc3-ff8535808e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9377daa7-3f5c-4621-8595-aebef69bef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.image.glance [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Creating Keystone auth plugin from conf {{(pid=82240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 20 17:06:23 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.987s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:23 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Deleted volume successfully. Apr 20 17:06:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e244d63c-8db0-4744-9cf1-2c41b23fa563 tempest-VolumesListAdminTestJSON-259784873 None] Lock "cinder-b5eee725-cbb3-4ac2-a5de-f9e90239dfa0-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9377daa7-3f5c-4621-8595-aebef69bef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '805eecd4-a975-4fab-b12a-691c655ddcfc', 'volume_name': 'volume-805eecd4-a975-4fab-b12a-691c655ddcfc', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36e4642-c3d8-4890-8a76-82a6a1ade2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36e4642-c3d8-4890-8a76-82a6a1ade2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2096f8-2ec1-40c3-8b29-fad19a58841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:24 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Volume 805eecd4-a975-4fab-b12a-691c655ddcfc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-805eecd4-a975-4fab-b12a-691c655ddcfc', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 20 17:06:24 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Trying to clone 805eecd4-a975-4fab-b12a-691c655ddcfc from image 295802c4-6388-4dc0-a97e-75ff54234992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]). {{(pid=82240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 20 17:06:24 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Apr 20 17:06:24 devstack cinder-volume[82240]: INFO cinder.image.image_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Image download 20.69 MB at 20.69 MB/s Apr 20 17:06:24 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1bbf2e-161d-4392-8100-7d9fc07eee51]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:24 devstack sudo[85510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD Apr 20 17:06:24 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:25 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD" returned: 0 in 1.304s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:25 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Temporary image 295802c4-6388-4dc0-a97e-75ff54234992 is fetched for user 142abd77d1e64600b76c5162dcf0811e. {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Apr 20 17:06:25 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[63403c03-1f3a-4374-aa96-979e01739b6f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:26 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD Apr 20 17:06:26 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Flow 'volume_create_manager' (4e7b9a87-7ceb-43cf-ba6b-880f063119b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4b3a2f-454b-46c7-9304-8c4effad343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4b3a2f-454b-46c7-9304-8c4effad343f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-595779567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac78b02-da3c-410b-b693-d2cf3ae04ebd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9fbc3f082877472b8036b18f54de2642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:26Z,use_quota=True,user_id='603dd2b57ae141db928ebbc5b334f3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f803e1-3d42-444a-8187-4dc11960ca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f803e1-3d42-444a-8187-4dc11960ca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307a5b65-1633-40f2-a222-02a50b6b649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307a5b65-1633-40f2-a222-02a50b6b649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ac78b02-da3c-410b-b693-d2cf3ae04ebd', 'volume_name': 'volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d2c45c-d7d8-47b0-a400-7dacea52f3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d2c45c-d7d8-47b0-a400-7dacea52f3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461ec572-f845-4917-937f-46695e7515ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Volume 2ac78b02-da3c-410b-b693-d2cf3ae04ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd', 'volume_size': 1} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-595779567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac78b02-da3c-410b-b693-d2cf3ae04ebd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9fbc3f082877472b8036b18f54de2642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:26Z,use_quota=True,user_id='603dd2b57ae141db928ebbc5b334f3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Creating volume 2ac78b02-da3c-410b-b693-d2cf3ae04ebd {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:26 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Flow 'volume_create_manager' (8fb481de-0dd6-4a66-9e70-e4c08fb5b0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8145f043-085e-453f-b8b0-700e6049ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd 1073741824 Apr 20 17:06:26 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8145f043-085e-453f-b8b0-700e6049ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-635850228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefa3968-c7a7-4e89-9e12-fe580b20b8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc017dda051240c9b37bb52977d8d8c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:27Z,use_quota=True,user_id='11b71fe89f784c69b309e6ff999ef2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c48f5f-1816-4b9c-bc08-156cde0c635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c48f5f-1816-4b9c-bc08-156cde0c635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1754885-50ca-4531-a549-f75eedff384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1754885-50ca-4531-a549-f75eedff384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aefa3968-c7a7-4e89-9e12-fe580b20b8ad', 'volume_name': 'volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1679f9-d958-426b-ba86-39a8c4b851b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1679f9-d958-426b-ba86-39a8c4b851b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37cdc7a-4ad8-44af-ba49-9bbad1a1ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:26 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad', 'volume_size': 1} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:26 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD" returned: 0 in 0.873s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Flow 'volume_create_manager' (219d4128-a90a-4377-a332-a5579bf24ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:27 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f31370c-3478-4225-90db-05bf14a8a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd 1073741824" returned: 0 in 0.705s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f31370c-3478-4225-90db-05bf14a8a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1153980282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8e04d2-b137-4844-83e0-a5cafee64c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42db82384754504b429bd4867a34e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:27Z,use_quota=True,user_id='6a19e69208cc41d2b0a03f5154ac2655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcf679d-4b86-4195-96f3-a376f95ca3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcf679d-4b86-4195-96f3-a376f95ca3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041212db-a7a7-487b-b1e3-4cade2a39074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.image.glance [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Creating Keystone auth plugin from conf {{(pid=82240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:27 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd Apr 20 17:06:27 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041212db-a7a7-487b-b1e3-4cade2a39074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae8e04d2-b137-4844-83e0-a5cafee64c77', 'volume_name': 'volume-ae8e04d2-b137-4844-83e0-a5cafee64c77', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ee2017-3324-49d6-87dd-9b15fa29fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ee2017-3324-49d6-87dd-9b15fa29fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4200276a-3252-461f-a538-90069ffc7d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:27 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Volume ae8e04d2-b137-4844-83e0-a5cafee64c77: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae8e04d2-b137-4844-83e0-a5cafee64c77', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Trying to clone ae8e04d2-b137-4844-83e0-a5cafee64c77 from image 295802c4-6388-4dc0-a97e-75ff54234992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]). {{(pid=82240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Apr 20 17:06:27 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Image download 20.69 MB at 20.69 MB/s Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[37974328-1785-442f-ac44-dbcf5e42c210]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:27 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD Apr 20 17:06:27 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:27 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd" returned: 0 in 0.558s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-635850228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefa3968-c7a7-4e89-9e12-fe580b20b8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc017dda051240c9b37bb52977d8d8c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:27Z,use_quota=True,user_id='11b71fe89f784c69b309e6ff999ef2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Creating volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:27 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461ec572-f845-4917-937f-46695e7515ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:27 devstack sudo[85551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad 1073741824 Apr 20 17:06:27 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcab5717-f359-41de-b549-e39fab34626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:28 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Volume volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd (2ac78b02-da3c-410b-b693-d2cf3ae04ebd): created successfully Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcab5717-f359-41de-b549-e39fab34626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Flow 'volume_create_manager' (4e7b9a87-7ceb-43cf-ba6b-880f063119b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-f921736a-0d30-4f3a-8c6b-23de21809016 req-91518ed3-cfe4-4662-96ec-f70452e48150 tempest-VolumesGetTestJSON-214950789 None] Created volume successfully. Apr 20 17:06:28 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Temporary image 295802c4-6388-4dc0-a97e-75ff54234992 is fetched for user 6a19e69208cc41d2b0a03f5154ac2655. {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddac6be-f89d-4efb-863b-fcc693e6b3ec]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:28 devstack sudo[85559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD Apr 20 17:06:28 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:28 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad 1073741824" returned: 0 in 0.550s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:28 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad Apr 20 17:06:28 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Acquiring lock "cinder-2ac78b02-da3c-410b-b693-d2cf3ae04ebd-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Lock "cinder-2ac78b02-da3c-410b-b693-d2cf3ae04ebd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Acquiring lock "cinder-quobyte-2ac78b02-da3c-410b-b693-d2cf3ae04ebd" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Lock "cinder-quobyte-2ac78b02-da3c-410b-b693-d2cf3ae04ebd" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[103bb99a-c252-424b-81f3-ba9dc2a592af]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:29 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:29 devstack sudo[85568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd Apr 20 17:06:29 devstack sudo[85568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:29 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" returned: 0 in 0.530s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.278s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805eecd4-a975-4fab-b12a-691c655ddcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a06b529e814daead58465e085916dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:23Z,use_quota=True,user_id='142abd77d1e64600b76c5162dcf0811e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Creating volume 805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:29 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37cdc7a-4ad8-44af-ba49-9bbad1a1ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:29 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc 1073741824 Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc63a25-26ef-4943-9cef-e3cde450b04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:29 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Volume volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad (aefa3968-c7a7-4e89-9e12-fe580b20b8ad): created successfully Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc63a25-26ef-4943-9cef-e3cde450b04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Flow 'volume_create_manager' (8fb481de-0dd6-4a66-9e70-e4c08fb5b0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:29 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d8f38c77-53dd-454c-9d03-cd18e31e79d2 tempest-SnapshotsActionsTest-602544372 None] Created volume successfully. Apr 20 17:06:29 devstack sudo[85568]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd" returned: 0 in 0.556s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:29 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd Apr 20 17:06:29 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:29 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc 1073741824" returned: 0 in 0.513s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:29 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:06:29 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:29 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2ac78b02-da3c-410b-b693-d2cf3ae04ebd" returned: 0 in 0.456s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Lock "cinder-quobyte-2ac78b02-da3c-410b-b693-d2cf3ae04ebd" released by "delete_volume" :: held 1.082s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:30 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:30 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.quota [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Created reservations ['b8445df1-ad30-443c-953b-7fcc85758f53', '3c547b8d-b486-42b1-9758-9477286021fd', '7440a87d-2540-47d6-91b6-c0b73094cd95', '870fd7e5-474e-420e-9673-7289010bc4ba'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:30 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:30 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:30 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 0 in 0.508s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1153980282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8e04d2-b137-4844-83e0-a5cafee64c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42db82384754504b429bd4867a34e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:27Z,use_quota=True,user_id='6a19e69208cc41d2b0a03f5154ac2655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Creating volume ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:30 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:30 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 1073741824 Apr 20 17:06:30 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Attempting download of 295802c4-6388-4dc0-a97e-75ff54234992 ((None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}])) to volume 805eecd4-a975-4fab-b12a-691c655ddcfc. {{(pid=82240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[516fc7f6-1716-48f6-9874-6df4dd04d872]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_rybytctz {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:30 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_rybytctz Apr 20 17:06:30 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:30 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.698s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:30 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_rybytctz" returned: 0 in 0.595s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_rybytctz {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:30 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.811s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.manager [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:30 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Deleted volume successfully. Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-7385736b-f624-4c60-88d9-6393e73f2cb9 req-1fccdbd9-8235-4375-b9b2-7d1041a8adeb tempest-VolumesGetTestJSON-214950789 None] Lock "cinder-2ac78b02-da3c-410b-b693-d2cf3ae04ebd-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:30 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 1073741824" returned: 0 in 0.808s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:31 devstack sudo[85610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_rybytctz Apr 20 17:06:31 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:31 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 Apr 20 17:06:31 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:31 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:31 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_rybytctz" returned: 1 in 0.686s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_rybytctz' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77" returned: 0 in 0.570s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7326e1c3-8b73-4975-8084-fe4a7a435f74]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.619s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Creating offline snapshot e86e2548-8143-4b7c-9358-9b6304cab42d of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a666a5b5-44ee-4178-9cbf-816204172e64]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Attempting download of 295802c4-6388-4dc0-a97e-75ff54234992 ((None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}])) to volume ae8e04d2-b137-4844-83e0-a5cafee64c77. {{(pid=82240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02f7689-a64b-4d9e-9666-e97c16b2c1a2]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_nblow1b5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:31 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD Apr 20 17:06:31 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:31 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad Apr 20 17:06:31 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:31 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_nblow1b5 Apr 20 17:06:31 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:32 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:32 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] 295802c4-6388-4dc0-a97e-75ff54234992 was qcow2, converting to raw {{(pid=82240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Apr 20 17:06:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:32 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:06:32 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:32 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_nblow1b5" returned: 0 in 0.794s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_nblow1b5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:32 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" returned: 0 in 0.874s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:32 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d 1G Apr 20 17:06:32 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:32 devstack sudo[85638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_nblow1b5 Apr 20 17:06:32 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:33 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_nblow1b5" returned: 1 in 0.895s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_nblow1b5' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8d2629-5d68-4474-9b77-3c4624e46c7a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:33 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d 1G" returned: 0 in 0.902s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:33 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:06:33 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:33 devstack sudo[85654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD Apr 20 17:06:33 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:33 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 0 in 1.366s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_1gupxwvwdevstack@QuobyteHD, size 112.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:06:33 devstack cinder-volume[82240]: INFO cinder.image.image_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Converted 112.00 MB image at 81.93 MB/s Apr 20 17:06:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:33 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc 1G Apr 20 17:06:33 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:34 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.693s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:34 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d is being set with open permissions: ugo+rw Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:34 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:06:34 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:34 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] 295802c4-6388-4dc0-a97e-75ff54234992 was qcow2, converting to raw {{(pid=82240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:34 devstack sudo[85668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 Apr 20 17:06:34 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:34 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc 1G" returned: 0 in 0.832s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4d5c22-ee01-49ba-aae3-20171c0c979b]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:34 devstack sudo[85673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:06:34 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:34 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.630s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:34 devstack sudo[85681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.info Apr 20 17:06:34 devstack sudo[85681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:35 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77" returned: 0 in 0.987s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:35 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_vnu0u5aqdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:06:35 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Converted 112.00 MB image at 112.00 MB/s Apr 20 17:06:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:35 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 1G Apr 20 17:06:35 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:35 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 0 in 0.825s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:35 devstack sudo[85681]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.info" returned: 0 in 0.642s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:35 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.info is being set with open permissions: ugo+rw Apr 20 17:06:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:35 devstack sudo[85689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.info Apr 20 17:06:35 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:35 devstack sudo[85688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:06:35 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:36 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 1G" returned: 0 in 0.877s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0304d764-733c-4579-9750-09a2e3e1eafa]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:36 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 1 in 0.699s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Downloaded image 295802c4-6388-4dc0-a97e-75ff54234992 ((None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}])) to volume 805eecd4-a975-4fab-b12a-691c655ddcfc successfully. {{(pid=82240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Temporary image 295802c4-6388-4dc0-a97e-75ff54234992 for user 142abd77d1e64600b76c5162dcf0811e is deleted. {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Marking volume 805eecd4-a975-4fab-b12a-691c655ddcfc as bootable. {{(pid=82240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Copying metadata from image 295802c4-6388-4dc0-a97e-75ff54234992 to 805eecd4-a975-4fab-b12a-691c655ddcfc. {{(pid=82240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Creating volume glance metadata for volume 805eecd4-a975-4fab-b12a-691c655ddcfc backed by image 295802c4-6388-4dc0-a97e-75ff54234992 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 20 17:06:36 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 Apr 20 17:06:36 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2096f8-2ec1-40c3-8b29-fad19a58841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805eecd4-a975-4fab-b12a-691c655ddcfc', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47eb26d-a51a-432d-976b-4a1ad07e0ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:36 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Volume volume-805eecd4-a975-4fab-b12a-691c655ddcfc (805eecd4-a975-4fab-b12a-691c655ddcfc): created successfully Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47eb26d-a51a-432d-976b-4a1ad07e0ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Flow 'volume_create_manager' (50dd16b5-476f-42e4-abf0-7843624157f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:36 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-4a857f16-5669-40b4-9238-64dec06bb35a tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Created volume successfully. Apr 20 17:06:36 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.info" returned: 0 in 0.893s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.715s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:36 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-873a3c5e-c5bb-43b7-bbe3-5b179678750a tempest-SnapshotsActionsTest-602544372 None] Create snapshot completed successfully Apr 20 17:06:36 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77" returned: 0 in 0.570s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:36 devstack sudo[85704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 Apr 20 17:06:36 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:37 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77" returned: 1 in 0.608s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Downloaded image 295802c4-6388-4dc0-a97e-75ff54234992 ((None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}])) to volume ae8e04d2-b137-4844-83e0-a5cafee64c77 successfully. {{(pid=82240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Temporary image 295802c4-6388-4dc0-a97e-75ff54234992 for user 6a19e69208cc41d2b0a03f5154ac2655 is deleted. {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Marking volume ae8e04d2-b137-4844-83e0-a5cafee64c77 as bootable. {{(pid=82240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Copying metadata from image 295802c4-6388-4dc0-a97e-75ff54234992 to ae8e04d2-b137-4844-83e0-a5cafee64c77. {{(pid=82240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Creating volume glance metadata for volume ae8e04d2-b137-4844-83e0-a5cafee64c77 backed by image 295802c4-6388-4dc0-a97e-75ff54234992 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4200276a-3252-461f-a538-90069ffc7d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8e04d2-b137-4844-83e0-a5cafee64c77', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf5b05f-f433-49dc-8b37-764fab2ccfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:37 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Volume volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 (ae8e04d2-b137-4844-83e0-a5cafee64c77): created successfully Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf5b05f-f433-49dc-8b37-764fab2ccfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Flow 'volume_create_manager' (219d4128-a90a-4377-a332-a5579bf24ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:37 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c47f9bf1-b417-4bad-9c4e-0fd711a3b3aa tempest-GroupsV314Test-526441252 None] Group tempest-GroupsV314Test-Group-1953369435: creating Apr 20 17:06:37 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-70bc0df9-056f-4769-86f7-28b9f3d6b6d9 tempest-VolumesImageMetadata-2132962537 None] Created volume successfully. Apr 20 17:06:37 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c47f9bf1-b417-4bad-9c4e-0fd711a3b3aa tempest-GroupsV314Test-526441252 None] Group tempest-GroupsV314Test-Group-1953369435: created successfully Apr 20 17:06:37 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c47f9bf1-b417-4bad-9c4e-0fd711a3b3aa tempest-GroupsV314Test-526441252 None] Create group completed successfully. Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Creating offline snapshot 9899f622-5bb5-455f-91f6-8a9d89ebde71 of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b549b5-62e4-46d0-a1c6-f235fc36e55e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:37 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:06:37 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:38 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.537s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:38 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 1G Apr 20 17:06:38 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Acquiring lock "cinder-ae8e04d2-b137-4844-83e0-a5cafee64c77-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Lock "cinder-ae8e04d2-b137-4844-83e0-a5cafee64c77-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Acquiring lock "cinder-quobyte-ae8e04d2-b137-4844-83e0-a5cafee64c77" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Lock "cinder-quobyte-ae8e04d2-b137-4844-83e0-a5cafee64c77" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[df34fdca-a026-4d99-a19f-fc9a470a20e1]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:38 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 Apr 20 17:06:38 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:38 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 1G" returned: 0 in 0.537s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:38 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 Apr 20 17:06:38 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Flow 'volume_create_manager' (b0d47c27-edac-46e3-a31f-5145da1c00f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a8b012-d4d9-4339-b1cc-ade9eedd4f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a8b012-d4d9-4339-b1cc-ade9eedd4f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1101601480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0985b80-1360-47ea-9fce-a1fca7d8eb51,host='devstack@QuobyteHD#QuobyteHD',id=5a87ea47-54b1-44b6-bcfb-41f85f6dd004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9e6055c48741509e5eb1c872097c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:39Z,use_quota=True,user_id='807e49c033a649088fe4ff7269bd5387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c2e525-44eb-43f9-9568-4a638726c080),volume_type_id=c5c2e525-44eb-43f9-9568-4a638726c080)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a258db69-c52e-4338-9d26-29e1eb09ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a258db69-c52e-4338-9d26-29e1eb09ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227bc982-e76e-4ed2-b90c-5af1223c2cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227bc982-e76e-4ed2-b90c-5af1223c2cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a87ea47-54b1-44b6-bcfb-41f85f6dd004', 'volume_name': 'volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2707f5-39d8-4ade-b1fc-89fb6a4f12e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2707f5-39d8-4ade-b1fc-89fb6a4f12e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c7d40-2258-4cbb-bcee-2c59c99f8794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Volume 5a87ea47-54b1-44b6-bcfb-41f85f6dd004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004', 'volume_size': 1} Apr 20 17:06:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:39 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77" returned: 0 in 0.542s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:39 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 Apr 20 17:06:39 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:39 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71" returned: 0 in 0.467s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:39 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 is being set with open permissions: ugo+rw Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:39 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 Apr 20 17:06:39 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:39 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77" returned: 1 in 0.532s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:39 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77 Apr 20 17:06:39 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:39 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71" returned: 0 in 0.441s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0985b80-1360-47ea-9fce-a1fca7d8eb51,created_at=2026-04-20T15:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1101601480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0985b80-1360-47ea-9fce-a1fca7d8eb51,host='devstack@QuobyteHD#QuobyteHD',id=5a87ea47-54b1-44b6-bcfb-41f85f6dd004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9e6055c48741509e5eb1c872097c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:39Z,use_quota=True,user_id='807e49c033a649088fe4ff7269bd5387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c2e525-44eb-43f9-9568-4a638726c080),volume_type_id=c5c2e525-44eb-43f9-9568-4a638726c080)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Creating volume 5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:39 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:39 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c03a153f-7308-48cd-b6ae-44234ea8be0b tempest-SnapshotsActionsTest-602544372 None] Create snapshot completed successfully Apr 20 17:06:39 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 1073741824 Apr 20 17:06:39 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:40 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae8e04d2-b137-4844-83e0-a5cafee64c77" returned: 0 in 0.418s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Lock "cinder-quobyte-ae8e04d2-b137-4844-83e0-a5cafee64c77" released by "delete_volume" :: held 1.537s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Created reservations ['e3c3fb1e-4470-4a3f-abff-07bb40ab7dd1', 'f3c7a0ae-98af-46bd-aacb-0d219eb68818', 'ab8a95cc-15ff-4c4f-9b2b-46019a6c88d7', '0be57d7a-1b47-4085-8ec7-6207a6475a32'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:40 devstack sudo[85754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:40 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:40 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 1073741824" returned: 0 in 0.506s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:40 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 Apr 20 17:06:40 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:40 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.438s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:40 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Deleted volume successfully. Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b21a6a12-fb29-4cdc-8e78-d7a84f5b434e tempest-VolumesImageMetadata-2132962537 None] Lock "cinder-ae8e04d2-b137-4844-83e0-a5cafee64c77-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:40 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" returned: 0 in 0.435s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.514s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c7d40-2258-4cbb-bcee-2c59c99f8794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26ec6f3-5eb9-4fb4-84b2-2cacad5819aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:40 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Volume volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 (5a87ea47-54b1-44b6-bcfb-41f85f6dd004): created successfully Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26ec6f3-5eb9-4fb4-84b2-2cacad5819aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Flow 'volume_create_manager' (b0d47c27-edac-46e3-a31f-5145da1c00f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a4753-27b5-457a-89d4-c5e335b34fe7]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:40 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a8f2b6ff-ed50-42d4-88a1-bdb7ada7e348 tempest-GroupsV314Test-526441252 None] Created volume successfully. Apr 20 17:06:40 devstack sudo[85760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:06:40 devstack sudo[85760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-9899f622-5bb5-455f-91f6-8a9d89ebde71-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-9899f622-5bb5-455f-91f6-8a9d89ebde71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-quobyte-9899f622-5bb5-455f-91f6-8a9d89ebde71" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-9899f622-5bb5-455f-91f6-8a9d89ebde71" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Deleting offline snapshot 9899f622-5bb5-455f-91f6-8a9d89ebde71 of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] snapshot_file for this snap is: volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[13411f0e-49ec-4b28-aca4-a2cc022cf7f7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:40 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 Apr 20 17:06:40 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:41 devstack sudo[85760]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 0 in 0.559s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:41 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:06:41 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:41 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71" returned: 0 in 0.604s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86eae41-cd03-4644-a855-9ecdb5b46182]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:41 devstack sudo[85771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:06:41 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:41 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 1 in 0.647s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.245s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:41 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Cloning volume 5a87ea47-54b1-44b6-bcfb-41f85f6dd004 to volume 57fbeee7-3e92-4972-ac07-772077f61d90 Apr 20 17:06:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0', 'name': 'volume-805eecd4-a975-4fab-b12a-691c655ddcfc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ec4b0e5-ae1c-4167-b9b1-578e7061156a', 'enforce_multipath': True} {{(pid=82240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Creating offline snapshot f38421b9-75d2-44a6-8364-efedc324bab4 of volume 5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f548077c-8517-4259-beb7-e400558ffd84]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:42 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-e5cd2dee-420a-459f-bf55-f79c1f846aca req-bf7a2331-5388-43d4-96ee-0444e8571563 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] attachment_update completed successfully. Apr 20 17:06:42 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 Apr 20 17:06:42 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:42 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.664s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:42 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 Apr 20 17:06:42 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:42 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" returned: 0 in 0.587s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:42 devstack sudo[85789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 1G Apr 20 17:06:42 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:42 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71" returned: 0 in 0.547s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:42 devstack sudo[85791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71 Apr 20 17:06:42 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:43 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 1G" returned: 0 in 0.610s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:43 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 Apr 20 17:06:43 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:43 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.9899f622-5bb5-455f-91f6-8a9d89ebde71" returned: 0 in 0.509s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-9899f622-5bb5-455f-91f6-8a9d89ebde71" released by "_delete_snapshot" :: held 2.379s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" released by "delete_snapshot" :: held 2.399s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Created reservations ['2999348b-7066-4451-9e1d-87e0d6287c14', '47e9f6d3-fe10-45cb-81a4-1d6a6258242c', 'ee8ee610-d0ce-4020-bd7c-ea4dfce1941b', '3c02aeee-561b-4f0e-b186-811bc8ded5a9'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Delete snapshot completed successfully. Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ee39427e-4560-4fc7-a374-def3de5c7390 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-9899f622-5bb5-455f-91f6-8a9d89ebde71-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:43 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4" returned: 0 in 0.531s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:43 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:06:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:43 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 Apr 20 17:06:43 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (82a2631f-1276-461d-8d25-74298b9a077d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10750df-7247-4edb-8416-5c89051e0615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10750df-7247-4edb-8416-5c89051e0615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-557891542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302455bc-91e1-49dc-8565-ffe4d3bfb673,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:44Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99bf294-e0ba-49de-ae7f-a00b16113997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99bf294-e0ba-49de-ae7f-a00b16113997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14aef03-bc6c-41c5-adef-c353f416f500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14aef03-bc6c-41c5-adef-c353f416f500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302455bc-91e1-49dc-8565-ffe4d3bfb673', 'volume_name': 'volume-302455bc-91e1-49dc-8565-ffe4d3bfb673', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b473cbf-7a02-40b2-8e89-6e688e12d76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b473cbf-7a02-40b2-8e89-6e688e12d76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e4f14d-91f5-431a-9a97-a68e6342a6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:44 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Volume 302455bc-91e1-49dc-8565-ffe4d3bfb673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302455bc-91e1-49dc-8565-ffe4d3bfb673', 'volume_size': 1} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:44 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4" returned: 0 in 0.525s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:44 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.info Apr 20 17:06:44 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:44 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.info" returned: 0 in 0.430s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:44 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.info is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:06:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:44 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.info Apr 20 17:06:44 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:45 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.info" returned: 0 in 0.422s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Acquiring lock "cinder-quobyte-57fbeee7-3e92-4972-ac07-772077f61d90" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Lock "cinder-quobyte-57fbeee7-3e92-4972-ac07-772077f61d90" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] snapshot: f38421b9-75d2-44a6-8364-efedc324bab4, volume: 57fbeee7-3e92-4972-ac07-772077f61d90, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbdd3e3-34b4-416d-93f7-ea3b5acfe3f8]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:45 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 Apr 20 17:06:45 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:45 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4" returned: 0 in 0.493s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df804f3-2d4e-4ad5-be7b-df364d524dd9]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:45 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 Apr 20 17:06:45 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:46 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:46 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:06:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:46 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 Apr 20 17:06:46 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:49 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90" returned: 0 in 3.199s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[536eaa9f-b583-4d6d-a4ff-795dfedf90d7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:49 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 Apr 20 17:06:49 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:50 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" returned: 0 in 0.721s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004, size 1024.00 MB, duration 3.20 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:06:50 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Converted 1024.00 MB image at 319.91 MB/s Apr 20 17:06:50 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:50 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 Apr 20 17:06:50 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:50 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90" returned: 0 in 0.468s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Lock "cinder-quobyte-57fbeee7-3e92-4972-ac07-772077f61d90" released by "_copy_volume_from_snapshot" :: held 5.410s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Acquiring lock "cinder-quobyte-f38421b9-75d2-44a6-8364-efedc324bab4" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Lock "cinder-quobyte-f38421b9-75d2-44a6-8364-efedc324bab4" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Deleting offline snapshot f38421b9-75d2-44a6-8364-efedc324bab4 of volume 5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] snapshot_file for this snap is: volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b59567-c142-4304-821a-dd2f99a4df7b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:50 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 Apr 20 17:06:50 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:51 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4" returned: 0 in 0.488s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:51 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c81861-cab8-4ded-bdc2-c639c6a2713e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:51 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 Apr 20 17:06:51 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:51 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" returned: 0 in 0.526s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:51 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 Apr 20 17:06:51 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:52 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:52 devstack sudo[85903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4 Apr 20 17:06:52 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:52 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004.f38421b9-75d2-44a6-8364-efedc324bab4" returned: 0 in 0.420s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Lock "cinder-quobyte-f38421b9-75d2-44a6-8364-efedc324bab4" released by "_delete_snapshot" :: held 1.962s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.637s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.318s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-557891542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302455bc-91e1-49dc-8565-ffe4d3bfb673,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:44Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Creating volume 302455bc-91e1-49dc-8565-ffe4d3bfb673 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:52 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:52 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 1073741824 Apr 20 17:06:52 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:52 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c621c0ab-76eb-4321-a6cf-5f6ffd870f96 tempest-GroupsV314Test-526441252 None] Create group from source-group-f0985b80-1360-47ea-9fce-a1fca7d8eb51 completed successfully. Apr 20 17:06:53 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 1073741824" returned: 0 in 0.540s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Acquiring lock "cinder-quobyte-57fbeee7-3e92-4972-ac07-772077f61d90" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:53 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 Apr 20 17:06:53 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Lock "cinder-quobyte-57fbeee7-3e92-4972-ac07-772077f61d90" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d60ed3-bab1-4154-af80-8d03f96ec472]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:53 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 Apr 20 17:06:53 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:53 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673" returned: 0 in 0.490s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.240s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Creating offline snapshot 18eaff8e-e768-4535-90dd-1cb073969062 of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b59ee3c-6334-457b-ba8e-ed7aeaf0e3b9]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e4f14d-91f5-431a-9a97-a68e6342a6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302455bc-91e1-49dc-8565-ffe4d3bfb673', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4cd151-0e67-45c0-b223-df07fae31e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:53 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:53 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Volume volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 (302455bc-91e1-49dc-8565-ffe4d3bfb673): created successfully Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4cd151-0e67-45c0-b223-df07fae31e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (82a2631f-1276-461d-8d25-74298b9a077d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90" returned: 0 in 0.544s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:53 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:06:53 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:53 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c90848dc-68ff-4628-a4de-f50d6166ac12 tempest-VolumesGetTest-374272221 None] Created volume successfully. Apr 20 17:06:53 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90 Apr 20 17:06:53 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:54 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.697s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:54 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 1G Apr 20 17:06:54 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (536447e8-f0c3-4647-8a8f-f3bfd28d302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67171556-9fe7-4b39-bd57-300216b1e31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:54 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67171556-9fe7-4b39-bd57-300216b1e31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-63616208',display_name='tempest-VolumesGetTest-Volume-1414944359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a4e3f8-5cdf-4413-8133-d277b7664174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:54Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4a92e5-fa15-49d4-9d02-e81f1cc1abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4a92e5-fa15-49d4-9d02-e81f1cc1abdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6849e13f-4efc-418f-a7c7-f94d5c0a17e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6849e13f-4efc-418f-a7c7-f94d5c0a17e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a4e3f8-5cdf-4413-8133-d277b7664174', 'volume_name': 'volume-90a4e3f8-5cdf-4413-8133-d277b7664174', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6650cb-0367-4bae-a40f-779ec9f7e49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6650cb-0367-4bae-a40f-779ec9f7e49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb2d1b2-781b-46f8-aa45-2d9b7679e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:54 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Volume 90a4e3f8-5cdf-4413-8133-d277b7664174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a4e3f8-5cdf-4413-8133-d277b7664174', 'volume_size': 1} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-57fbeee7-3e92-4972-ac07-772077f61d90" returned: 0 in 0.742s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Lock "cinder-quobyte-57fbeee7-3e92-4972-ac07-772077f61d90" released by "delete_volume" :: held 1.306s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Created reservations ['263005f2-bdfa-4a45-82cf-50e8164b4727'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:54 devstack cinder-volume[82240]: WARNING cinder.quota [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-404959672 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-404959672, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:06:54 devstack cinder-volume[82240]: WARNING cinder.quota [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-404959672 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-404959672, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Created reservations ['49b7089c-adfe-40f5-80d3-6e32b13efa95', '3f320e55-3368-4ec9-bc43-1ebc05514f37', 'c6aa5fb1-d620-4157-97a6-a5ace52db5ee', 'a276967e-2381-4936-8656-bf11da54e30c'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:54 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:54 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:54 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 1G" returned: 0 in 0.545s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:54 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 Apr 20 17:06:54 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:55 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.435s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:55 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5e203270-4bf1-4195-a3df-a4ca95324de2 tempest-GroupsV314Test-526441252 None] Delete group completed successfully. Apr 20 17:06:55 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062" returned: 0 in 0.617s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:55 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 is being set with open permissions: ugo+rw Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:55 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 Apr 20 17:06:55 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Acquiring lock "cinder-quobyte-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Lock "cinder-quobyte-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf21ae74-a842-47ad-83fd-a00d34594e10]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:55 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 Apr 20 17:06:55 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:55 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062" returned: 0 in 0.428s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:06:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-63616208',display_name='tempest-VolumesGetTest-Volume-1414944359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a4e3f8-5cdf-4413-8133-d277b7664174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:06:54Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Creating volume 90a4e3f8-5cdf-4413-8133-d277b7664174 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:06:55 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:06:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:56 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 1073741824 Apr 20 17:06:56 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:56 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3c195d26-9411-489e-9012-ac4c4135f851 tempest-SnapshotsActionsTest-602544372 None] Create snapshot completed successfully Apr 20 17:06:56 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" returned: 0 in 0.517s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:56 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004 Apr 20 17:06:56 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:56 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" returned: 0 in 0.411s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Lock "cinder-quobyte-5a87ea47-54b1-44b6-bcfb-41f85f6dd004" released by "delete_volume" :: held 0.957s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:56 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 1073741824" returned: 0 in 0.583s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Created reservations ['984086f0-9b3b-4113-a6e8-7aa9633afd90'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:56 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 Apr 20 17:06:56 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Created reservations ['65aa35e7-783b-4ee7-b6c0-ec51817acbb2', '51a169f4-0fe2-49df-ad65-54d22fb658d1', '70934b6d-75c4-4047-9706-0b3a152ab776', '3e870c6e-7c42-412c-9cc2-6e34d536deab'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:56 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:56 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-18eaff8e-e768-4535-90dd-1cb073969062-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-18eaff8e-e768-4535-90dd-1cb073969062-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-quobyte-18eaff8e-e768-4535-90dd-1cb073969062" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-18eaff8e-e768-4535-90dd-1cb073969062" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Deleting offline snapshot 18eaff8e-e768-4535-90dd-1cb073969062 of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:06:56 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] snapshot_file for this snap is: volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b17d841-494c-444c-9263-0ca87a05b820]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:57 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174" returned: 0 in 0.435s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb2d1b2-781b-46f8-aa45-2d9b7679e415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a4e3f8-5cdf-4413-8133-d277b7664174', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80933d62-4803-429b-819f-405badacb1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:06:57 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Volume volume-90a4e3f8-5cdf-4413-8133-d277b7664174 (90a4e3f8-5cdf-4413-8133-d277b7664174): created successfully Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80933d62-4803-429b-819f-405badacb1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (536447e8-f0c3-4647-8a8f-f3bfd28d302b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:06:57 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-61e7f8c5-92d6-4ee2-a42f-174cb9606fcf tempest-VolumesGetTest-374272221 None] Created volume successfully. Apr 20 17:06:57 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 Apr 20 17:06:57 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:57 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:57 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-58d544e5-174d-4076-b163-4b90bf288f01 tempest-GroupsV314Test-526441252 None] Delete group completed successfully. Apr 20 17:06:57 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0a1e5c-bec6-4dd8-a659-e3207e32cdaa]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:57 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:06:57 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-90a4e3f8-5cdf-4413-8133-d277b7664174-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Lock "cinder-90a4e3f8-5cdf-4413-8133-d277b7664174-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-90a4e3f8-5cdf-4413-8133-d277b7664174" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-90a4e3f8-5cdf-4413-8133-d277b7664174" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d7d03-3ee5-4599-9411-35bf8651ba1d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:06:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:57 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 Apr 20 17:06:57 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:58 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.577s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:58 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 Apr 20 17:06:58 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:58 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174" returned: 0 in 0.566s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:58 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174 Apr 20 17:06:58 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:58 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062" returned: 0 in 0.552s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:58 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062 Apr 20 17:06:58 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:58 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-90a4e3f8-5cdf-4413-8133-d277b7664174" returned: 0 in 0.469s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-90a4e3f8-5cdf-4413-8133-d277b7664174" released by "delete_volume" :: held 1.057s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Created reservations ['d604f3a6-7458-4487-8cb6-d5d947c31319', 'd1311507-9258-4043-9846-400ddbea8d9f', '12209b90-3f62-4be5-80c8-8d29b6248e5b', '615f454d-58bf-4012-9e2c-ececf4061e81'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:06:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:06:58 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:06:58 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:06:59 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.18eaff8e-e768-4535-90dd-1cb073969062" returned: 0 in 0.530s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-18eaff8e-e768-4535-90dd-1cb073969062" released by "_delete_snapshot" :: held 2.197s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" released by "delete_snapshot" :: held 2.211s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:59 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Created reservations ['a2b82929-a6a5-4a95-b7ec-dcf2eb31373b', '3b29616d-70a9-4aaa-9279-e0ee5b0d08b9', '863f6548-57d2-4128-b306-17dda1dfea3c', 'ee7202c9-9d5d-4548-9da6-c91181d1c5dc'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:06:59 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Delete snapshot completed successfully. Apr 20 17:06:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-af3898af-9673-4b61-87b2-d8867c2915f1 tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-18eaff8e-e768-4535-90dd-1cb073969062-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:06:59 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 20 17:06:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.567s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:06:59 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:06:59 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Deleted volume successfully. Apr 20 17:06:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31ca9154-6e1f-4b75-88cf-098a4b02995f tempest-VolumesGetTest-374272221 None] Lock "cinder-90a4e3f8-5cdf-4413-8133-d277b7664174-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-302455bc-91e1-49dc-8565-ffe4d3bfb673-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Lock "cinder-302455bc-91e1-49dc-8565-ffe4d3bfb673-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-302455bc-91e1-49dc-8565-ffe4d3bfb673" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-302455bc-91e1-49dc-8565-ffe4d3bfb673" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce329a7-0245-46b2-b5a8-78cf20dd0c2b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:00 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 Apr 20 17:07:00 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Creating offline snapshot 3e30cfa3-08f1-4a02-8259-3da1202587e7 of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef2b6a6-2dcd-419d-890d-3b06e79c9ff3]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:00 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:07:00 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:00 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673" returned: 0 in 0.769s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:00 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673 Apr 20 17:07:00 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:01 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.768s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:01 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 1G Apr 20 17:07:01 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:01 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-302455bc-91e1-49dc-8565-ffe4d3bfb673" returned: 0 in 0.600s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-302455bc-91e1-49dc-8565-ffe4d3bfb673" released by "delete_volume" :: held 1.443s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Created reservations ['d393598c-a44b-4991-b51f-357785e0b07c', 'aa349339-2ba7-4260-b8f5-9b729a016dd6', 'd3ca6809-2c57-4a73-9f89-4e7312d326f7', '30abd029-393f-48c7-b37e-579f2a435962'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:01 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:01 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:02 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:02 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Deleted volume successfully. Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99b6f10a-4d9c-4962-8b09-0048ed3f6a1c tempest-VolumesGetTest-374272221 None] Lock "cinder-302455bc-91e1-49dc-8565-ffe4d3bfb673-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:02 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 1G" returned: 0 in 0.928s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:02 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 Apr 20 17:07:02 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (f9a73a35-a26c-4b7c-a8f0-09148b0d153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e180c2-0db3-4d4f-a655-6e86f32a568b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e180c2-0db3-4d4f-a655-6e86f32a568b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1404804477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0beb27a4-02bf-4643-86fe-f36ef543b426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:03Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a9b6dd-b802-4613-bf45-b204e83f2b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a9b6dd-b802-4613-bf45-b204e83f2b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31dcb5c-44f7-4d4d-b11f-2ad38ebacb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31dcb5c-44f7-4d4d-b11f-2ad38ebacb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0beb27a4-02bf-4643-86fe-f36ef543b426', 'volume_name': 'volume-0beb27a4-02bf-4643-86fe-f36ef543b426', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391b5804-0ad5-426d-b037-9bf27336ce6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391b5804-0ad5-426d-b037-9bf27336ce6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d7c709-0144-4639-9e68-0378ea7d1f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:02 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Volume 0beb27a4-02bf-4643-86fe-f36ef543b426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0beb27a4-02bf-4643-86fe-f36ef543b426', 'volume_size': 1} Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:02 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7" returned: 0 in 0.625s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:02 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 is being set with open permissions: ugo+rw Apr 20 17:07:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:02 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 Apr 20 17:07:02 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Flow 'volume_create_manager' (9e4830b7-8603-4329-8d08-bc762409521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55eaa22-b06d-4ff1-8ec3-1d3edbda6abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55eaa22-b06d-4ff1-8ec3-1d3edbda6abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-784134313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3c2b72-c2fd-4677-a02f-212360029725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af301fd75624e05b1cb3f543c2378df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:03Z,use_quota=True,user_id='8d8a0fb35e62495393c1fe564776bd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77798dc0-0399-43ee-b656-20abab665786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77798dc0-0399-43ee-b656-20abab665786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f44fb6-b737-4736-8435-b80695f7ca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f44fb6-b737-4736-8435-b80695f7ca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3c2b72-c2fd-4677-a02f-212360029725', 'volume_name': 'volume-7f3c2b72-c2fd-4677-a02f-212360029725', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271dd071-b89b-42e9-93fe-2d4f195e2a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271dd071-b89b-42e9-93fe-2d4f195e2a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acab6476-c91f-4346-bf63-80168e5e107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:03 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Volume 7f3c2b72-c2fd-4677-a02f-212360029725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3c2b72-c2fd-4677-a02f-212360029725', 'volume_size': 1} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:03 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.936s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1404804477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0beb27a4-02bf-4643-86fe-f36ef543b426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:03Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Creating volume 0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:03 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:03 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 1073741824 Apr 20 17:07:03 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:03 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ecd08471-4fce-4d37-8fa4-db2e9b725836 tempest-SnapshotsActionsTest-602544372 None] Create snapshot completed successfully Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-3e30cfa3-08f1-4a02-8259-3da1202587e7-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-3e30cfa3-08f1-4a02-8259-3da1202587e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-quobyte-3e30cfa3-08f1-4a02-8259-3da1202587e7" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-3e30cfa3-08f1-4a02-8259-3da1202587e7" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Deleting offline snapshot 3e30cfa3-08f1-4a02-8259-3da1202587e7 of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] snapshot_file for this snap is: volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35fe036-7289-40de-919f-18cc2bc4f237]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:03 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 Apr 20 17:07:03 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:04 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 1073741824" returned: 0 in 0.671s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:04 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 Apr 20 17:07:04 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:04 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7" returned: 0 in 0.584s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7772c7-329b-4c5b-a600-68384879066d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:04 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:07:04 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:04 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426" returned: 0 in 0.671s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.643s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-784134313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3c2b72-c2fd-4677-a02f-212360029725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af301fd75624e05b1cb3f543c2378df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:03Z,use_quota=True,user_id='8d8a0fb35e62495393c1fe564776bd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Creating volume 7f3c2b72-c2fd-4677-a02f-212360029725 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:04 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d7c709-0144-4639-9e68-0378ea7d1f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0beb27a4-02bf-4643-86fe-f36ef543b426', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40a7733-1bf0-4f2b-822f-a05027ec54bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:04 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 1073741824 Apr 20 17:07:04 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:04 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Volume volume-0beb27a4-02bf-4643-86fe-f36ef543b426 (0beb27a4-02bf-4643-86fe-f36ef543b426): created successfully Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40a7733-1bf0-4f2b-822f-a05027ec54bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (f9a73a35-a26c-4b7c-a8f0-09148b0d153c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b41ace77-ecc1-4bf6-8f12-49529eb55615 tempest-VolumesGetTest-374272221 None] Created volume successfully. Apr 20 17:07:05 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.720s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:05 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 Apr 20 17:07:05 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:05 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 1073741824" returned: 0 in 0.622s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:05 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 Apr 20 17:07:05 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:05 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7" returned: 0 in 0.586s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:05 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7 Apr 20 17:07:05 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:06 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725" returned: 0 in 0.577s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acab6476-c91f-4346-bf63-80168e5e107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3c2b72-c2fd-4677-a02f-212360029725', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42597e6-284b-40a8-bb80-d20578947f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Volume volume-7f3c2b72-c2fd-4677-a02f-212360029725 (7f3c2b72-c2fd-4677-a02f-212360029725): created successfully Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42597e6-284b-40a8-bb80-d20578947f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Flow 'volume_create_manager' (9e4830b7-8603-4329-8d08-bc762409521f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:06 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5356f5e8-c0ad-44aa-b082-744e49a73547 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Created volume successfully. Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (d0ea4a75-653f-48be-8e40-7995cc402160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ec119e-766d-46ae-b35c-5b5f360d34bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ec119e-766d-46ae-b35c-5b5f360d34bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1635971491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8520a2b2-c97e-40f0-84e3-8437eea03e5d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0beb27a4-02bf-4643-86fe-f36ef543b426,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:06Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7ff20c-8fbd-48f7-9d0a-b9b06083decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7ff20c-8fbd-48f7-9d0a-b9b06083decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abe8f1e-3ba3-4d57-9827-7db2663b18eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abe8f1e-3ba3-4d57-9827-7db2663b18eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8520a2b2-c97e-40f0-84e3-8437eea03e5d', 'volume_name': 'volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d', 'volume_size': 1, 'source_volid': '0beb27a4-02bf-4643-86fe-f36ef543b426', 'source_volstatus': 'available'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f2bc49-1801-43a4-b4f2-7bd4537691f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f2bc49-1801-43a4-b4f2-7bd4537691f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081b56f4-bcf3-43b0-b779-3fb219b85927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Volume 8520a2b2-c97e-40f0-84e3-8437eea03e5d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d', 'volume_size': 1, 'source_volid': '0beb27a4-02bf-4643-86fe-f36ef543b426', 'source_volstatus': 'available'} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:06 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Cloning volume 0beb27a4-02bf-4643-86fe-f36ef543b426 to volume 8520a2b2-c97e-40f0-84e3-8437eea03e5d Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Creating offline snapshot 329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 of volume 0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeeb780-801f-4de9-b43b-c8b553048344]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:06 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.3e30cfa3-08f1-4a02-8259-3da1202587e7" returned: 0 in 0.695s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-3e30cfa3-08f1-4a02-8259-3da1202587e7" released by "_delete_snapshot" :: held 2.659s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" released by "delete_snapshot" :: held 2.681s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:06 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 Apr 20 17:07:06 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Created reservations ['96cc091b-18b6-4959-a006-46a25b6facfe', '26c176bf-6af0-4555-9697-cce75482d6bc', '48619c20-274d-44e7-933a-e2efd33cba4e', '49a080f4-1ffe-4b4f-be72-91240bb52a5f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Acquiring lock "cinder-7f3c2b72-c2fd-4677-a02f-212360029725-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "cinder-7f3c2b72-c2fd-4677-a02f-212360029725-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:06 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Delete snapshot completed successfully. Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a09fa497-fb9d-49ac-b186-829e3528f20d tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-3e30cfa3-08f1-4a02-8259-3da1202587e7-delete_snapshot" released by "delete_snapshot" :: held 2.940s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Acquiring lock "cinder-quobyte-7f3c2b72-c2fd-4677-a02f-212360029725" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "cinder-quobyte-7f3c2b72-c2fd-4677-a02f-212360029725" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10dc860-6792-42b4-895b-19bd72853491]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:06 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 Apr 20 17:07:06 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:07 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426" returned: 0 in 0.811s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:07 devstack sudo[86190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 1G Apr 20 17:07:07 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:07 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725" returned: 0 in 0.613s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:07 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725 Apr 20 17:07:07 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:07 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 1G" returned: 0 in 0.568s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0beb27a4-02bf-4643-86fe-f36ef543b426 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:07 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0beb27a4-02bf-4643-86fe-f36ef543b426 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 Apr 20 17:07:07 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:07 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7f3c2b72-c2fd-4677-a02f-212360029725" returned: 0 in 0.567s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "cinder-quobyte-7f3c2b72-c2fd-4677-a02f-212360029725" released by "delete_volume" :: held 1.205s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:07 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Created reservations ['115ddcbd-bacc-4c45-afcb-601c34d35b06', '2512c848-2fef-48f0-94b5-ee64beec26d6', '91dc328a-93be-49a4-a9f9-fd00487209d5', 'fcf38280-ec55-4b1f-bf65-b9e342dbc62d'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:08 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:08 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:08 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0beb27a4-02bf-4643-86fe-f36ef543b426 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" returned: 0 in 0.530s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:08 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 is being set with open permissions: ugo+rw Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:08 devstack sudo[86235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 Apr 20 17:07:08 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:08 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.462s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:08 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Deleted volume successfully. Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd974047-afd7-472e-9e17-a0abdaf913ac tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "cinder-7f3c2b72-c2fd-4677-a02f-212360029725-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:08 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" returned: 0 in 0.414s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:08 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.info Apr 20 17:07:08 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:09 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Flow 'volume_create_manager' (a2456385-4e8b-4a4b-926a-24e4d3c0f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fffe23-0264-4433-83ac-834c2ad60268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.info" returned: 0 in 0.475s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:09 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.info is being set with open permissions: ugo+rw Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:09 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.info Apr 20 17:07:09 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fffe23-0264-4433-83ac-834c2ad60268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1176413334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31eda94-f194-4732-9d4a-fa8fb6013a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af301fd75624e05b1cb3f543c2378df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:09Z,use_quota=True,user_id='8d8a0fb35e62495393c1fe564776bd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d9e59e-7309-490f-9666-d2b760395429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d9e59e-7309-490f-9666-d2b760395429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5fece2-40e9-4ce0-bec1-a856f9453bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5fece2-40e9-4ce0-bec1-a856f9453bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31eda94-f194-4732-9d4a-fa8fb6013a77', 'volume_name': 'volume-f31eda94-f194-4732-9d4a-fa8fb6013a77', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2079728-085b-4878-b1f8-10201fd049a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2079728-085b-4878-b1f8-10201fd049a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6fcc43-b45f-434d-be16-ad9ff57ca89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:09 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Volume f31eda94-f194-4732-9d4a-fa8fb6013a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31eda94-f194-4732-9d4a-fa8fb6013a77', 'volume_size': 1} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:09 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.info" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-8520a2b2-c97e-40f0-84e3-8437eea03e5d" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-8520a2b2-c97e-40f0-84e3-8437eea03e5d" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] snapshot: 329ee4f9-f84b-46f2-95aa-af1d30ddb7a8, volume: 8520a2b2-c97e-40f0-84e3-8437eea03e5d, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2bd323-d87a-47d7-b3c8-435f2cbf0be4]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:09 devstack sudo[86248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 Apr 20 17:07:09 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:10 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" returned: 0 in 0.472s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0beb27a4-02bf-4643-86fe-f36ef543b426(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[32200477-b5a2-4a1c-ad2d-04f3f15e1391]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:10 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 Apr 20 17:07:10 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=173,cinder:INSERT=61,cinder:UPDATE=198,cinder:DELETE=9 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:07:10 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-f004315b-97b0-4277-a7da-1376bbb620c4 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Terminate volume connection completed successfully. Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-f004315b-97b0-4277-a7da-1376bbb620c4 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Deleting attachment 4ec4b0e5-ae1c-4167-b9b1-578e7061156a. {{(pid=82240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 20 17:07:10 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426" returned: 0 in 0.499s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:10 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d Apr 20 17:07:10 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "cinder-805eecd4-a975-4fab-b12a-691c655ddcfc-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "cinder-805eecd4-a975-4fab-b12a-691c655ddcfc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "cinder-quobyte-805eecd4-a975-4fab-b12a-691c655ddcfc" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "cinder-quobyte-805eecd4-a975-4fab-b12a-691c655ddcfc" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[550886b6-7e47-4d4c-83dd-cc8a18c37e2c]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:11 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:07:11 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:11 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 0 in 1.002s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:12 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:07:12 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:13 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 1 in 1.059s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:13 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc Apr 20 17:07:13 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:13 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d" returned: 0 in 2.454s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad741ef-ca5d-43de-987e-fce3c55c5427]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:13 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 Apr 20 17:07:13 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:13 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-805eecd4-a975-4fab-b12a-691c655ddcfc" returned: 0 in 0.462s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "cinder-quobyte-805eecd4-a975-4fab-b12a-691c655ddcfc" released by "delete_volume" :: held 2.566s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG cinder.quota [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Created reservations ['d1572172-4f7c-47b6-8bc8-cca86f5de264', '8e1d7706-4069-40c4-a350-e43f28319c20', '7c7f8d78-3cea-4745-9eaa-ad3d7fe86e19', '5cdcbf60-f793-4721-976f-93ed876c7e37'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:13 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:13 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:13 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426" returned: 0 in 0.653s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:07:13 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Converted 1024.00 MB image at 417.11 MB/s Apr 20 17:07:13 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d is being set with open permissions: ugo+rw Apr 20 17:07:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:13 devstack sudo[86324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d Apr 20 17:07:13 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:14 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG cinder.manager [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Deleted volume successfully. Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-95c64cb9-eeaf-4a15-9a6c-ed3d5275e91c req-b5334d45-5de3-471d-a242-5ea1e3d5f6d9 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "cinder-805eecd4-a975-4fab-b12a-691c655ddcfc-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:14 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d" returned: 0 in 0.473s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-8520a2b2-c97e-40f0-84e3-8437eea03e5d" released by "_copy_volume_from_snapshot" :: held 4.599s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Deleting offline snapshot 329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 of volume 0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] snapshot_file for this snap is: volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cec6a82-4a27-40e2-b44f-91909522be9b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:14 devstack sudo[86329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 Apr 20 17:07:14 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:14 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" returned: 0 in 0.516s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0beb27a4-02bf-4643-86fe-f36ef543b426(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cca122-e12b-4648-b669-e460d7154d50]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:14 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 Apr 20 17:07:14 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:15 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426" returned: 0 in 0.516s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:15 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 Apr 20 17:07:15 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:15 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:15 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8 Apr 20 17:07:15 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:16 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426.329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" returned: 0 in 0.422s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-329ee4f9-f84b-46f2-95aa-af1d30ddb7a8" released by "_delete_snapshot" :: held 2.054s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.063s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.164s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081b56f4-bcf3-43b0-b779-3fb219b85927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d', 'volume_size': 1, 'source_volid': '0beb27a4-02bf-4643-86fe-f36ef543b426', 'source_volstatus': 'available'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22728bb2-c2ae-4c8c-8dd1-5a337198ea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Creating offline snapshot a9ab777d-ba26-4481-9db6-61592cc30415 of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:07:16 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Volume volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d (8520a2b2-c97e-40f0-84e3-8437eea03e5d): created successfully Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22728bb2-c2ae-4c8c-8dd1-5a337198ea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (d0ea4a75-653f-48be-8e40-7995cc402160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0bc01e-e51b-439e-a81f-f9c0692af8c7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:16 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f61f1c3a-d71f-4de5-972d-243e654092cf tempest-VolumesGetTest-374272221 None] Created volume successfully. Apr 20 17:07:16 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:07:16 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:17 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.582s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:17 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 1G Apr 20 17:07:17 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (8e42c877-b0de-4b6c-b027-1cadffb86594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6345d07b-cb75-4a90-8a2a-49f8f88ae744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6345d07b-cb75-4a90-8a2a-49f8f88ae744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-951194172',display_name='tempest-VolumesGetTest-Volume-590080218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b6d340-f6c7-442f-8b25-fd1759257660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:17Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe62bbf4-491e-49c6-87cf-161d3193f42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe62bbf4-491e-49c6-87cf-161d3193f42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a863eb79-2dda-420e-9776-3a80fb825c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a863eb79-2dda-420e-9776-3a80fb825c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b6d340-f6c7-442f-8b25-fd1759257660', 'volume_name': 'volume-06b6d340-f6c7-442f-8b25-fd1759257660', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51dbe819-0bcb-41ca-aec4-33f05403a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51dbe819-0bcb-41ca-aec4-33f05403a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29eacf4b-9b36-4ccd-be07-4b5c3befa140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:17 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Volume 06b6d340-f6c7-442f-8b25-fd1759257660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b6d340-f6c7-442f-8b25-fd1759257660', 'volume_size': 1} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:17 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 1G" returned: 0 in 0.598s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:17 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 Apr 20 17:07:17 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:18 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415" returned: 0 in 0.464s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:18 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 is being set with open permissions: ugo+rw Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:18 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 Apr 20 17:07:18 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:18 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415" returned: 0 in 0.421s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.265s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1176413334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31eda94-f194-4732-9d4a-fa8fb6013a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af301fd75624e05b1cb3f543c2378df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:09Z,use_quota=True,user_id='8d8a0fb35e62495393c1fe564776bd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Creating volume f31eda94-f194-4732-9d4a-fa8fb6013a77 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:18 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:18 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 1073741824 Apr 20 17:07:18 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:18 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f8a5cff0-ccf7-46d5-9a3d-003fa7429f83 tempest-SnapshotsActionsTest-602544372 None] Create snapshot completed successfully Apr 20 17:07:19 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 1073741824" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:19 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 Apr 20 17:07:19 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:19 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77" returned: 0 in 0.430s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.165s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-951194172',display_name='tempest-VolumesGetTest-Volume-590080218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b6d340-f6c7-442f-8b25-fd1759257660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:17Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Creating volume 06b6d340-f6c7-442f-8b25-fd1759257660 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:19 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6fcc43-b45f-434d-be16-ad9ff57ca89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31eda94-f194-4732-9d4a-fa8fb6013a77', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:19 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 1073741824 Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298d4cfe-d93b-4eb4-9383-fee4b7f237e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:19 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:19 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Volume volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 (f31eda94-f194-4732-9d4a-fa8fb6013a77): created successfully Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298d4cfe-d93b-4eb4-9383-fee4b7f237e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Flow 'volume_create_manager' (a2456385-4e8b-4a4b-926a-24e4d3c0f008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:19 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ee99aba2-495d-4690-8d65-a1ac92527934 tempest-VolumeQuotasAdminTestJSON-2104060004 None] Created volume successfully. Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-a9ab777d-ba26-4481-9db6-61592cc30415-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-a9ab777d-ba26-4481-9db6-61592cc30415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Acquiring lock "cinder-quobyte-a9ab777d-ba26-4481-9db6-61592cc30415" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-a9ab777d-ba26-4481-9db6-61592cc30415" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Deleting offline snapshot a9ab777d-ba26-4481-9db6-61592cc30415 of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] snapshot_file for this snap is: volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[114bd098-906c-428d-922e-7c2ca5a090f7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:19 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 Apr 20 17:07:19 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:20 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 1073741824" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:20 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 Apr 20 17:07:20 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3c1f0482-b416-4674-9484-171c36fc3f87 tempest-VolumeQuotasAdminTestJSON-588929655 None] Transfer volume completed successfully. Apr 20 17:07:20 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415" returned: 0 in 0.547s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c56f3b0-a897-455d-8222-baa1ef022a1a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:20 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:07:20 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:20 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660" returned: 0 in 0.464s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29eacf4b-9b36-4ccd-be07-4b5c3befa140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b6d340-f6c7-442f-8b25-fd1759257660', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a742f7-980c-49b8-8d09-3592cfb9e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:20 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Volume volume-06b6d340-f6c7-442f-8b25-fd1759257660 (06b6d340-f6c7-442f-8b25-fd1759257660): created successfully Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a742f7-980c-49b8-8d09-3592cfb9e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (8e42c877-b0de-4b6c-b027-1cadffb86594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-02a2d25b-a9bb-46dc-9ce9-aa740b4609bf tempest-VolumesGetTest-374272221 None] Created volume successfully. Apr 20 17:07:20 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.525s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:20 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 Apr 20 17:07:20 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Acquiring lock "cinder-f31eda94-f194-4732-9d4a-fa8fb6013a77-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Lock "cinder-f31eda94-f194-4732-9d4a-fa8fb6013a77-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Acquiring lock "cinder-quobyte-f31eda94-f194-4732-9d4a-fa8fb6013a77" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Lock "cinder-quobyte-f31eda94-f194-4732-9d4a-fa8fb6013a77" acquired by "delete_volume" :: waited 0.022s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6776d771-5b3f-4e94-89f2-929d4e7f6dea]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:21 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 Apr 20 17:07:21 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:21 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:21 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415 Apr 20 17:07:21 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:21 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77" returned: 0 in 0.536s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-06b6d340-f6c7-442f-8b25-fd1759257660-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:21 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77 Apr 20 17:07:21 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Lock "cinder-06b6d340-f6c7-442f-8b25-fd1759257660-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-06b6d340-f6c7-442f-8b25-fd1759257660" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-06b6d340-f6c7-442f-8b25-fd1759257660" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[005c33b5-bfcf-407c-ad6d-ee09fae7110c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:21 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.a9ab777d-ba26-4481-9db6-61592cc30415" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-a9ab777d-ba26-4481-9db6-61592cc30415" released by "_delete_snapshot" :: held 2.066s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" released by "delete_snapshot" :: held 2.077s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Created reservations ['b3cb3c03-e9ea-4ee7-a203-70cdcae0763e', 'dfbf8898-1396-452f-89d9-7b5c540c18f1', 'e9215776-de7f-4b36-8dc9-5a369a6e9a93', '435811b9-a613-4e3c-82b0-cae444376b1d'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:21 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 Apr 20 17:07:21 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:21 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Delete snapshot completed successfully. Apr 20 17:07:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb783e47-5da9-4904-9f41-74be1a8955aa tempest-SnapshotsActionsTest-844502631 None] Lock "cinder-a9ab777d-ba26-4481-9db6-61592cc30415-delete_snapshot" released by "delete_snapshot" :: held 2.161s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:22 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f31eda94-f194-4732-9d4a-fa8fb6013a77" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Lock "cinder-quobyte-f31eda94-f194-4732-9d4a-fa8fb6013a77" released by "delete_volume" :: held 1.063s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Created reservations ['8709a4d8-a7ce-423a-ac13-f066081992ae', '3ec477ef-e1f5-4aa4-b36f-25c899b145bb', 'bb4dd89a-287a-41d2-8967-139a94fa778a', '37f623f4-75e6-49b3-a6f3-47cc06bbcb6b'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:22 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:22 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:22 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660" returned: 0 in 0.523s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:22 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660 Apr 20 17:07:22 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:22 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.408s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:22 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Deleted volume successfully. Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:INSERT=47,cinder:SELECT=153,cinder:UPDATE=146,cinder:DELETE=16 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d0870e68-fdeb-491a-95a1-8d4833f19a57 tempest-VolumeQuotasAdminTestJSON-1699262272 None] Lock "cinder-f31eda94-f194-4732-9d4a-fa8fb6013a77-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:22 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-06b6d340-f6c7-442f-8b25-fd1759257660" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-06b6d340-f6c7-442f-8b25-fd1759257660" released by "delete_volume" :: held 1.015s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Created reservations ['2bf8712f-b858-49d5-b6ce-7f8fb4d56e3f', '222e5d5b-4226-47ee-9990-aa0211f39551', '7617c771-c539-4792-b4e3-a1bb3efdf228', '2c7bc30d-bc82-429f-8272-c2a5c86f73c7'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:22 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:22 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "cinder-e86e2548-8143-4b7c-9358-9b6304cab42d-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-e86e2548-8143-4b7c-9358-9b6304cab42d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "cinder-quobyte-e86e2548-8143-4b7c-9358-9b6304cab42d" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-quobyte-e86e2548-8143-4b7c-9358-9b6304cab42d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Deleting offline snapshot e86e2548-8143-4b7c-9358-9b6304cab42d of volume aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] snapshot_file for this snap is: volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[826a3408-30b8-4fc3-8dfc-ac4a010381fa]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:23 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:07:23 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:23 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.498s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:23 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Deleted volume successfully. Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4691a05e-695e-46e8-a2ee-dfd61091116b tempest-VolumesGetTest-374272221 None] Lock "cinder-06b6d340-f6c7-442f-8b25-fd1759257660-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:23 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.513s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[237ef090-0da2-4383-b259-b4ceec73af16]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:23 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad Apr 20 17:07:23 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-8520a2b2-c97e-40f0-84e3-8437eea03e5d-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Lock "cinder-8520a2b2-c97e-40f0-84e3-8437eea03e5d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-8520a2b2-c97e-40f0-84e3-8437eea03e5d" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-8520a2b2-c97e-40f0-84e3-8437eea03e5d" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b280537a-188a-4e62-b9fd-8fb011ab21cd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:23 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d Apr 20 17:07:23 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:24 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" returned: 0 in 0.616s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:24 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:07:24 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:24 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d" returned: 0 in 0.656s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:24 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d Apr 20 17:07:24 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:24 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.531s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:24 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d Apr 20 17:07:24 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:25 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8520a2b2-c97e-40f0-84e3-8437eea03e5d" returned: 0 in 0.520s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-8520a2b2-c97e-40f0-84e3-8437eea03e5d" released by "delete_volume" :: held 1.199s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Created reservations ['22d7a32f-b775-4635-a4b5-0d6cb22b1508', 'f602b1a0-bff6-4586-9e73-1b009e1ca891', '75c743c7-bec4-49f8-ac84-208203573c8c', 'e698a1e7-ef1f-4e25-8e9a-05ae2aba84ab'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:25 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:25 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-0696638d-4ff2-4629-a391-aa805a83ce56 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Terminate volume connection completed successfully. Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-0696638d-4ff2-4629-a391-aa805a83ce56 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Deleting attachment 970057dd-8a51-484d-879b-f87a79c0d5a3. {{(pid=82240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 20 17:07:25 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad.e86e2548-8143-4b7c-9358-9b6304cab42d" returned: 0 in 0.553s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-quobyte-e86e2548-8143-4b7c-9358-9b6304cab42d" released by "_delete_snapshot" :: held 2.279s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" released by "delete_snapshot" :: held 2.289s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Created reservations ['d5b1925a-7184-40fd-a420-db4a78fe3ac6', '42bd92f8-7967-4e4c-90d8-347333522a6e', 'f51628f0-ee50-4354-a98f-e00e85f6f936', '34509728-31ff-440e-9e35-d762ca06cc0a'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Delete snapshot completed successfully. Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3bf743e0-78b4-476e-9b6e-ed0d1dbc23de tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-e86e2548-8143-4b7c-9358-9b6304cab42d-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:25 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.474s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Deleted volume successfully. Apr 20 17:07:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f216681e-6c48-430a-bed1-a2855e8de28d tempest-VolumesGetTest-374272221 None] Lock "cinder-8520a2b2-c97e-40f0-84e3-8437eea03e5d-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "cinder-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "cinder-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "cinder-quobyte-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "cinder-quobyte-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5" acquired by "delete_volume" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5344cb64-343c-4cac-a924-939830f89417]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-0beb27a4-02bf-4643-86fe-f36ef543b426-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Lock "cinder-0beb27a4-02bf-4643-86fe-f36ef543b426-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-0beb27a4-02bf-4643-86fe-f36ef543b426" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-0beb27a4-02bf-4643-86fe-f36ef543b426" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:26 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 Apr 20 17:07:26 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a7300a-5a6e-4393-a937-24741a57dd34]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:26 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 Apr 20 17:07:26 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "cinder-aefa3968-c7a7-4e89-9e12-fe580b20b8ad-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-aefa3968-c7a7-4e89-9e12-fe580b20b8ad-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" acquired by "delete_volume" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a19e0fa-f270-4e5c-ba9a-31bc9096c238]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:26 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad Apr 20 17:07:26 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:26 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5" returned: 0 in 0.620s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:26 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5 Apr 20 17:07:26 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:26 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426" returned: 0 in 0.649s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:26 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426 Apr 20 17:07:26 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:27 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" returned: 0 in 0.618s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:27 devstack sudo[86526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad Apr 20 17:07:27 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:27 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5" returned: 0 in 0.518s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "cinder-quobyte-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5" released by "delete_volume" :: held 1.173s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.quota [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Created reservations ['c56b938f-959f-42b7-875e-bb9f9ba6c967', 'b9a12af5-7227-4ae3-a898-e8784daafa48', '12675b19-6e51-44e6-98ae-dd0f06f3a13b', '4bb1831e-2de4-48da-b9d7-7b0b7d00436e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:27 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:27 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:27 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0beb27a4-02bf-4643-86fe-f36ef543b426" returned: 0 in 0.577s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-0beb27a4-02bf-4643-86fe-f36ef543b426" released by "delete_volume" :: held 1.255s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Created reservations ['706c5954-d926-4a12-b5c6-99a1563ab419', '27627096-d651-4dc1-b7be-783a703b50c1', 'b6d92764-da07-4122-8c31-fb0a29841e02', '778124aa-da75-430b-bc54-0223bbf44a79'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:27 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:27 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:27 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" returned: 0 in 0.608s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-quobyte-aefa3968-c7a7-4e89-9e12-fe580b20b8ad" released by "delete_volume" :: held 1.262s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Created reservations ['51c00d4a-aa76-4b49-ab0f-d8d055936108', '2523ae0d-1ca0-4eda-aa42-f4b47b8e2394', '1ee079eb-6958-417b-8241-586722935345', '8ecb857f-26b7-4427-81ad-8498b0b4d4d8'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:27 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:27 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:27 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.manager [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:27 devstack cinder-volume[82240]: INFO cinder.volume.manager [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Deleted volume successfully. Apr 20 17:07:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [req-bd58c971-73a6-46f6-8dcf-314b5fe7f0c8 req-eb2db050-f616-4173-b7df-0fd906c43fe2 tempest-ServerBootFromVolumeStableRescueTest-1981457333 None] Lock "cinder-8eac0ae7-a603-4d8f-a01f-6b9ada1779f5-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:28 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Flow 'volume_create_manager' (a0eed0b2-b460-4fca-a532-b76d148a3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8df22a7-4ad2-4a7a-958c-8e08e1469178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.566s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8df22a7-4ad2-4a7a-958c-8e08e1469178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1828841758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2873bf9c-1232-4d18-a7d0-8cb0c26a1206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f24d65419a4d849d85b5e00bae3c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:28Z,use_quota=True,user_id='c264f2ffbf8344a1bfe1c9679ce31b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b9878b-747d-4463-9b29-57a6783a8082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b9878b-747d-4463-9b29-57a6783a8082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d93d2e-aa30-43ab-89da-2a74f84fe472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d93d2e-aa30-43ab-89da-2a74f84fe472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2873bf9c-1232-4d18-a7d0-8cb0c26a1206', 'volume_name': 'volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981a5d4d-6b6e-4990-b78d-6ba80a3c5fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981a5d4d-6b6e-4990-b78d-6ba80a3c5fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045d7f67-6cf1-47a6-a0e3-cce6c834d7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:28 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Volume 2873bf9c-1232-4d18-a7d0-8cb0c26a1206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206', 'volume_size': 1} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1828841758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2873bf9c-1232-4d18-a7d0-8cb0c26a1206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f24d65419a4d849d85b5e00bae3c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:28Z,use_quota=True,user_id='c264f2ffbf8344a1bfe1c9679ce31b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Creating volume 2873bf9c-1232-4d18-a7d0-8cb0c26a1206 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:28 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Deleted volume successfully. Apr 20 17:07:28 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 1073741824 Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5dd632c-9ac0-479d-a8eb-16886a02ad2c tempest-VolumesGetTest-374272221 None] Lock "cinder-0beb27a4-02bf-4643-86fe-f36ef543b426-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:28 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:28 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.513s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Deleted volume successfully. Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f14b2833-6b78-46c6-8fbb-15d5dc3dc380 tempest-SnapshotsActionsTest-602544372 None] Lock "cinder-aefa3968-c7a7-4e89-9e12-fe580b20b8ad-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:28 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 1073741824" returned: 0 in 0.559s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:28 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 Apr 20 17:07:28 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (69d501d2-e187-4f94-9b77-ce7f9dfcadf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6cf3e9-9245-418a-8fd8-a1632b9b63e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6cf3e9-9245-418a-8fd8-a1632b9b63e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2130937422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4affd7fa-9c16-49fb-a3c5-d3417eb84a8c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:29Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe66638-1c97-4f3c-b247-e19a7953ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe66638-1c97-4f3c-b247-e19a7953ced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06116140-0827-4da0-892a-ec49ca76c97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:28 devstack cinder-volume[82240]: DEBUG cinder.image.glance [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Creating Keystone auth plugin from conf {{(pid=82240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06116140-0827-4da0-892a-ec49ca76c97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4affd7fa-9c16-49fb-a3c5-d3417eb84a8c', 'volume_name': 'volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e86d539-16d2-48e7-8204-d7840f053b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e86d539-16d2-48e7-8204-d7840f053b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c220b6-5ab9-49be-8ecc-de4eae7832fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Volume 4affd7fa-9c16-49fb-a3c5-d3417eb84a8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Trying to clone 4affd7fa-9c16-49fb-a3c5-d3417eb84a8c from image 295802c4-6388-4dc0-a97e-75ff54234992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]). {{(pid=82240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 20 17:07:29 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206" returned: 0 in 0.614s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045d7f67-6cf1-47a6-a0e3-cce6c834d7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54abc9ef-ced3-483c-81d6-e969b3a088c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Apr 20 17:07:29 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Image download 20.69 MB at 20.69 MB/s Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d6d8e0-17fc-4648-bacc-76e6a05c5438]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Volume volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 (2873bf9c-1232-4d18-a7d0-8cb0c26a1206): created successfully Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54abc9ef-ced3-483c-81d6-e969b3a088c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Flow 'volume_create_manager' (a0eed0b2-b460-4fca-a532-b76d148a3788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:29 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e384cf7b-11c6-4eb7-a4b9-ed2088adab3c tempest-VolumesServicesTestJSON-294114395 None] Created volume successfully. Apr 20 17:07:29 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD Apr 20 17:07:29 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:30 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Temporary image 295802c4-6388-4dc0-a97e-75ff54234992 is fetched for user 4536c6a159764f14a2999e4ab7b60748. {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Apr 20 17:07:30 devstack sudo[86563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:30 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7e2d6b-6479-475d-8a8e-644705e606a1]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:30 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD Apr 20 17:07:30 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Acquiring lock "cinder-2873bf9c-1232-4d18-a7d0-8cb0c26a1206-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Lock "cinder-2873bf9c-1232-4d18-a7d0-8cb0c26a1206-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Acquiring lock "cinder-quobyte-2873bf9c-1232-4d18-a7d0-8cb0c26a1206" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Lock "cinder-quobyte-2873bf9c-1232-4d18-a7d0-8cb0c26a1206" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c8023-4c25-43a0-aeaa-fd80cd7f225d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:30 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 Apr 20 17:07:30 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:30 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.552s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:30 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD" returned: 0 in 0.750s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2130937422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4affd7fa-9c16-49fb-a3c5-d3417eb84a8c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:29Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Creating volume 4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:30 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:30 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c 1073741824 Apr 20 17:07:30 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:31 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206" returned: 0 in 0.681s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:31 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206 Apr 20 17:07:31 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:31 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c 1073741824" returned: 0 in 0.632s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:31 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c Apr 20 17:07:31 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:31 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2873bf9c-1232-4d18-a7d0-8cb0c26a1206" returned: 0 in 0.586s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Lock "cinder-quobyte-2873bf9c-1232-4d18-a7d0-8cb0c26a1206" released by "delete_volume" :: held 1.290s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Created reservations ['96d8515a-67fd-4915-bbbc-c799d6695859', '0a086419-8d44-4e06-93e8-19a9243a48d8', '0b7763cd-3870-4b26-8835-c18bbde32cb1', 'ce255263-d93a-455a-8684-76cd79b65c4e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:31 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:31 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:32 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" returned: 0 in 0.541s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Attempting download of 295802c4-6388-4dc0-a97e-75ff54234992 ((None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}])) to volume 4affd7fa-9c16-49fb-a3c5-d3417eb84a8c. {{(pid=82240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d504998-462b-47c0-9b4a-9f426d8b2982]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_1ikf_5k5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:32 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.506s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:32 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Deleted volume successfully. Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b543e20f-3d04-4744-b061-5d2aef450c38 tempest-VolumesServicesTestJSON-294114395 None] Lock "cinder-2873bf9c-1232-4d18-a7d0-8cb0c26a1206-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:32 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_1ikf_5k5 Apr 20 17:07:32 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:32 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_1ikf_5k5" returned: 0 in 0.664s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_1ikf_5k5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:32 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_1ikf_5k5 Apr 20 17:07:32 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:33 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_1ikf_5k5" returned: 1 in 0.550s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_1ikf_5k5' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:07:33 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[078548e0-702b-4462-a7cd-2fee6ace5516]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:33 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD Apr 20 17:07:33 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:33 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD" returned: 0 in 0.593s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:33 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] 295802c4-6388-4dc0-a97e-75ff54234992 was qcow2, converting to raw {{(pid=82240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Apr 20 17:07:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:34 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c Apr 20 17:07:34 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:34 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" returned: 0 in 0.968s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:34 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_s1j3tdt5devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:07:34 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Converted 112.00 MB image at 112.00 MB/s Apr 20 17:07:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:34 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c 1G Apr 20 17:07:34 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:35 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c 1G" returned: 0 in 0.533s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dd12af-ae1c-4b10-9f89-d5b86e9c3156]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:35 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c Apr 20 17:07:35 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:36 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" returned: 0 in 0.612s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:36 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c Apr 20 17:07:36 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Flow 'volume_create_manager' (d9b6740d-6344-462a-a720-a35346dd56e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672c02f4-2fd7-4c59-a44a-b865ed476822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672c02f4-2fd7-4c59-a44a-b865ed476822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1602024299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342807d1-5cb3-42b9-92ad-ecacbdc11276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6e603cb4c2412b9bb01dc787679f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:37Z,use_quota=True,user_id='7b8c3861f3504e33b72a41b01e7498fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6867cc3b-e769-4d3b-a73f-fcd9bbd24bb8),volume_type_id=6867cc3b-e769-4d3b-a73f-fcd9bbd24bb8)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ef1ba9-fe63-47a3-8462-4a6e48036e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ef1ba9-fe63-47a3-8462-4a6e48036e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6113ce3-b701-44ef-9770-a7cd491528a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6113ce3-b701-44ef-9770-a7cd491528a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342807d1-5cb3-42b9-92ad-ecacbdc11276', 'volume_name': 'volume-342807d1-5cb3-42b9-92ad-ecacbdc11276', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e7fd7a-3456-4c03-9d14-8c37a049ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e7fd7a-3456-4c03-9d14-8c37a049ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a26721c-bf01-4a63-a572-d31727dbd6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:36 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Volume 342807d1-5cb3-42b9-92ad-ecacbdc11276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342807d1-5cb3-42b9-92ad-ecacbdc11276', 'volume_size': 1} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1602024299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342807d1-5cb3-42b9-92ad-ecacbdc11276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6e603cb4c2412b9bb01dc787679f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:37Z,use_quota=True,user_id='7b8c3861f3504e33b72a41b01e7498fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6867cc3b-e769-4d3b-a73f-fcd9bbd24bb8),volume_type_id=6867cc3b-e769-4d3b-a73f-fcd9bbd24bb8)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Creating volume 342807d1-5cb3-42b9-92ad-ecacbdc11276 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:36 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:36 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 1073741824 Apr 20 17:07:36 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:36 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" returned: 1 in 0.682s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Downloaded image 295802c4-6388-4dc0-a97e-75ff54234992 ((None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}])) to volume 4affd7fa-9c16-49fb-a3c5-d3417eb84a8c successfully. {{(pid=82240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Temporary image 295802c4-6388-4dc0-a97e-75ff54234992 for user 4536c6a159764f14a2999e4ab7b60748 is deleted. {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Marking volume 4affd7fa-9c16-49fb-a3c5-d3417eb84a8c as bootable. {{(pid=82240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Copying metadata from image 295802c4-6388-4dc0-a97e-75ff54234992 to 4affd7fa-9c16-49fb-a3c5-d3417eb84a8c. {{(pid=82240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Creating volume glance metadata for volume 4affd7fa-9c16-49fb-a3c5-d3417eb84a8c backed by image 295802c4-6388-4dc0-a97e-75ff54234992 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c220b6-5ab9-49be-8ecc-de4eae7832fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a353557e-ff71-4192-8ec5-b3e89ba55f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:36 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Volume volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c (4affd7fa-9c16-49fb-a3c5-d3417eb84a8c): created successfully Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a353557e-ff71-4192-8ec5-b3e89ba55f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (69d501d2-e187-4f94-9b77-ce7f9dfcadf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:36 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b150420b-800e-4daa-886e-d27459748036 tempest-VolumesGetTest-374272221 None] Created volume successfully. Apr 20 17:07:37 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 1073741824" returned: 0 in 0.668s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:37 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 Apr 20 17:07:37 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (af5b5c24-2c6b-49d8-8e80-5e1d5c460300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6517552-274a-48e0-a8d9-e5120449808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6517552-274a-48e0-a8d9-e5120449808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1552052438',display_name='tempest-VolumesGetTest-Volume-1050758745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4967320b-a0b9-407c-9c2e-62b931109ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:38Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb02904-3a47-4d99-8cc3-dac1d96f07de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb02904-3a47-4d99-8cc3-dac1d96f07de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6f215c-5d03-4053-9d34-94cf86c79357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6f215c-5d03-4053-9d34-94cf86c79357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4967320b-a0b9-407c-9c2e-62b931109ef0', 'volume_name': 'volume-4967320b-a0b9-407c-9c2e-62b931109ef0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe71388-0a48-4f87-bd42-566f1d79f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe71388-0a48-4f87-bd42-566f1d79f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de9f38d-f7cb-4e6f-a1ec-e8fe35ef3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:37 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Volume 4967320b-a0b9-407c-9c2e-62b931109ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4967320b-a0b9-407c-9c2e-62b931109ef0', 'volume_size': 1} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:37 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276" returned: 0 in 0.562s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1552052438',display_name='tempest-VolumesGetTest-Volume-1050758745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4967320b-a0b9-407c-9c2e-62b931109ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cf36b827fb4ae597f4392233e834bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:38Z,use_quota=True,user_id='4536c6a159764f14a2999e4ab7b60748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Creating volume 4967320b-a0b9-407c-9c2e-62b931109ef0 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:37 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:37 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 1073741824 Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a26721c-bf01-4a63-a572-d31727dbd6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342807d1-5cb3-42b9-92ad-ecacbdc11276', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:37 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffca3c4-1c45-40c4-8a7a-aefa467b0a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:37 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Volume volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 (342807d1-5cb3-42b9-92ad-ecacbdc11276): created successfully Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffca3c4-1c45-40c4-8a7a-aefa467b0a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Flow 'volume_create_manager' (d9b6740d-6344-462a-a720-a35346dd56e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-da1eb828-d40f-4bfe-8f43-53ddec68c2b3 tempest-VolumeTypesAccessTest-1387828626 None] Created volume successfully. Apr 20 17:07:38 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 1073741824" returned: 0 in 0.583s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:38 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 Apr 20 17:07:38 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Acquiring lock "cinder-342807d1-5cb3-42b9-92ad-ecacbdc11276-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Lock "cinder-342807d1-5cb3-42b9-92ad-ecacbdc11276-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Acquiring lock "cinder-quobyte-342807d1-5cb3-42b9-92ad-ecacbdc11276" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Lock "cinder-quobyte-342807d1-5cb3-42b9-92ad-ecacbdc11276" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:38 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fe74ff-8c32-467e-a7c9-79fb6657150d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:38 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 Apr 20 17:07:38 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:39 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0" returned: 0 in 0.527s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de9f38d-f7cb-4e6f-a1ec-e8fe35ef3655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4967320b-a0b9-407c-9c2e-62b931109ef0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32379ea0-e94c-4d83-b694-c95c2c4da96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:39 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Volume volume-4967320b-a0b9-407c-9c2e-62b931109ef0 (4967320b-a0b9-407c-9c2e-62b931109ef0): created successfully Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32379ea0-e94c-4d83-b694-c95c2c4da96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Flow 'volume_create_manager' (af5b5c24-2c6b-49d8-8e80-5e1d5c460300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:39 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5bbced77-88e0-4759-b326-4b0a78efc52c tempest-VolumesGetTest-374272221 None] Created volume successfully. Apr 20 17:07:39 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276" returned: 0 in 0.559s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:39 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276 Apr 20 17:07:39 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:39 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-342807d1-5cb3-42b9-92ad-ecacbdc11276" returned: 0 in 0.457s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Lock "cinder-quobyte-342807d1-5cb3-42b9-92ad-ecacbdc11276" released by "delete_volume" :: held 1.040s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:39 devstack cinder-volume[82240]: WARNING cinder.quota [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1917339932 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1917339932, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:07:39 devstack cinder-volume[82240]: WARNING cinder.quota [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1917339932 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1917339932, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Created reservations ['331e9e61-b037-46a8-b529-767902630414', 'e12a5ab0-e39d-40e8-87e6-ec9758897538', 'c6d0e15c-4b41-4ab7-810c-4d40ad9e7d3e', '000ec7be-fa18-4e99-9c30-ec865a6b1a8e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:40 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:40 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-4967320b-a0b9-407c-9c2e-62b931109ef0-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Lock "cinder-4967320b-a0b9-407c-9c2e-62b931109ef0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-4967320b-a0b9-407c-9c2e-62b931109ef0" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-4967320b-a0b9-407c-9c2e-62b931109ef0" acquired by "delete_volume" :: waited 0.018s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5105f6-be7c-4121-b08a-92a462e4cb8b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:40 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 Apr 20 17:07:40 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:40 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.540s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:40 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Deleted volume successfully. Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2b32a94a-6e8d-479d-95fb-e5721a273d56 tempest-VolumeTypesAccessTest-1387828626 None] Lock "cinder-342807d1-5cb3-42b9-92ad-ecacbdc11276-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:40 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0" returned: 0 in 0.561s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:40 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0 Apr 20 17:07:40 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:41 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-00ee8446-90d9-4d44-955c-a74ff7ed3144 tempest-GroupSnapshotsTest-1138843432 None] Group tempest-GroupSnapshotsTest-Group-1691869007: creating Apr 20 17:07:41 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-00ee8446-90d9-4d44-955c-a74ff7ed3144 tempest-GroupSnapshotsTest-1138843432 None] Group tempest-GroupSnapshotsTest-Group-1691869007: created successfully Apr 20 17:07:41 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-00ee8446-90d9-4d44-955c-a74ff7ed3144 tempest-GroupSnapshotsTest-1138843432 None] Create group completed successfully. Apr 20 17:07:41 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4967320b-a0b9-407c-9c2e-62b931109ef0" returned: 0 in 0.578s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-4967320b-a0b9-407c-9c2e-62b931109ef0" released by "delete_volume" :: held 1.172s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Created reservations ['0b8c83bd-6b3b-4a1d-aa99-bf50e0c2e42e', 'beb14b34-a5cc-40e1-96e8-a9e8a1a21194', '478bd84a-99f6-4c85-8996-2892ec358094', '4856e292-2738-4cd0-98a4-5fc501273da9'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:41 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:41 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:41 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.500s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:41 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:41 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Deleted volume successfully. Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-d63d0a9e-7cbf-49fc-9a4e-cff94f853e8e tempest-VolumesGetTest-374272221 None] Lock "cinder-4967320b-a0b9-407c-9c2e-62b931109ef0-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Lock "cinder-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Acquiring lock "cinder-quobyte-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fd3694-8e4a-409e-9e66-97b05f1a652f]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:42 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c Apr 20 17:07:42 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Flow 'volume_create_manager' (a0ad6c91-894a-4cd5-a333-1f7cc95a94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07379cd-20e7-49f5-85bd-a11d543a4275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07379cd-20e7-49f5-85bd-a11d543a4275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325061552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afec24ff-fc05-49d1-b906-9e742f4f49f6,host='devstack@QuobyteHD#QuobyteHD',id=f6b864b0-2a5b-4f78-a82b-e787ca0c1139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b894766013a7425ead4b55c74f68e99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:43Z,use_quota=True,user_id='823dab3fc04548648007022d1de9ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd59cd2d-db1e-48f6-8ccb-412fff0561d0),volume_type_id=dd59cd2d-db1e-48f6-8ccb-412fff0561d0)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551e59a8-a7b4-4987-9d0a-ce5323f14bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551e59a8-a7b4-4987-9d0a-ce5323f14bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6295d11-35f3-4add-8470-47313a0891ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6295d11-35f3-4add-8470-47313a0891ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b864b0-2a5b-4f78-a82b-e787ca0c1139', 'volume_name': 'volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29590c08-8cde-426a-a468-5c8125e24f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29590c08-8cde-426a-a468-5c8125e24f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1c0425-388f-4b3e-abd0-ed95921c8f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:42 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Volume f6b864b0-2a5b-4f78-a82b-e787ca0c1139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139', 'volume_size': 1} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=afec24ff-fc05-49d1-b906-9e742f4f49f6,created_at=2026-04-20T15:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325061552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afec24ff-fc05-49d1-b906-9e742f4f49f6,host='devstack@QuobyteHD#QuobyteHD',id=f6b864b0-2a5b-4f78-a82b-e787ca0c1139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b894766013a7425ead4b55c74f68e99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:43Z,use_quota=True,user_id='823dab3fc04548648007022d1de9ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd59cd2d-db1e-48f6-8ccb-412fff0561d0),volume_type_id=dd59cd2d-db1e-48f6-8ccb-412fff0561d0)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Creating volume f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:42 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:42 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 1073741824 Apr 20 17:07:42 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:43 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" returned: 0 in 0.694s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:43 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c Apr 20 17:07:43 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:43 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 1073741824" returned: 0 in 0.667s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:43 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 Apr 20 17:07:43 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:43 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" returned: 1 in 0.688s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:07:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:43 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" returned: 0 in 0.521s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1c0425-388f-4b3e-abd0-ed95921c8f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6c60e4-cdce-4a3e-ab4e-db777c96e557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:44 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c Apr 20 17:07:44 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:44 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Volume volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 (f6b864b0-2a5b-4f78-a82b-e787ca0c1139): created successfully Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6c60e4-cdce-4a3e-ab4e-db777c96e557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Flow 'volume_create_manager' (a0ad6c91-894a-4cd5-a333-1f7cc95a94b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:44 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-00d7282b-5fb8-4d8f-9072-99dcb099d695 tempest-GroupSnapshotsTest-1138843432 None] Created volume successfully. Apr 20 17:07:44 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" returned: 0 in 0.579s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Lock "cinder-quobyte-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c" released by "delete_volume" :: held 2.033s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Created reservations ['da282852-e511-4da0-9146-23e4386028d9', '030f7130-d306-4f05-94d4-ffa051a09287', '472ee89d-7e5b-4c0b-8dde-49fe28187664', '86e21068-890d-4eb6-8faa-6ed33afd5a89'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:44 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:44 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:45 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] GroupSnapshot f13f17e5-282d-4f00-964f-433c93aa342c: creating. Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Group snapshot f13f17e5-282d-4f00-964f-433c93aa342c: creating. {{(pid=82240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Creating offline snapshot d074f82e-cea0-493d-92f3-e2c82f9bab1e of volume f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8434deba-516e-47f9-adae-a4e2a09401dd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:45 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.548s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:45 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Deleted volume successfully. Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46940c5d-f07e-4f12-ad55-b776c8170c15 tempest-VolumesGetTest-374272221 None] Lock "cinder-4affd7fa-9c16-49fb-a3c5-d3417eb84a8c-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:45 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 Apr 20 17:07:45 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:45 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" returned: 0 in 0.634s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:45 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e 1G Apr 20 17:07:45 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:46 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e 1G" returned: 0 in 0.659s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:46 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e Apr 20 17:07:46 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Flow 'volume_create_manager' (034ab3f1-d2e3-44e5-adbb-f74952575d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3991ab06-b790-461e-8ac4-59ac4bdb9068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3991ab06-b790-461e-8ac4-59ac4bdb9068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1023032084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf6ffb9-8bfa-4111-97ef-737d0acbe12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93892723d08045f2a4b9414a40c96418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:47Z,use_quota=True,user_id='3287aeb5962144b9a3d0108910cd1685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e448eb1a-8388-43a4-a6a9-0d63a44bcb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e448eb1a-8388-43a4-a6a9-0d63a44bcb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d3bb51-f77c-4d0d-badb-91f848357c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d3bb51-f77c-4d0d-badb-91f848357c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf6ffb9-8bfa-4111-97ef-737d0acbe12f', 'volume_name': 'volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6e5cb4-df7b-4636-ae7b-a09c17fff1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6e5cb4-df7b-4636-ae7b-a09c17fff1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b7e758-8e65-4b32-9601-d272468801b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:46 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Volume bbf6ffb9-8bfa-4111-97ef-737d0acbe12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f', 'volume_size': 1} Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:46 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e" returned: 0 in 0.569s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:46 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:07:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:47 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e Apr 20 17:07:47 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:47 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e" returned: 0 in 0.540s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:47 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.info Apr 20 17:07:47 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:48 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.info" returned: 0 in 0.598s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:48 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.info is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:48 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.info Apr 20 17:07:48 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:48 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.info" returned: 0 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.580s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1023032084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf6ffb9-8bfa-4111-97ef-737d0acbe12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93892723d08045f2a4b9414a40c96418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:47Z,use_quota=True,user_id='3287aeb5962144b9a3d0108910cd1685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Creating volume bbf6ffb9-8bfa-4111-97ef-737d0acbe12f {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:48 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:48 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f 1073741824 Apr 20 17:07:48 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:48 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4b6fcf26-f795-4829-b53b-eb87b51e452b tempest-GroupSnapshotsTest-1138843432 None] group_snapshot f13f17e5-282d-4f00-964f-433c93aa342c: created successfully Apr 20 17:07:49 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f 1073741824" returned: 0 in 0.629s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:49 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f Apr 20 17:07:49 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:49 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" returned: 0 in 0.533s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b7e758-8e65-4b32-9601-d272468801b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c37632-6a15-41c3-ad68-ecc850e99c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:49 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Volume volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f (bbf6ffb9-8bfa-4111-97ef-737d0acbe12f): created successfully Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c37632-6a15-41c3-ad68-ecc850e99c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Flow 'volume_create_manager' (034ab3f1-d2e3-44e5-adbb-f74952575d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-efb1c262-783c-4bd5-bd39-9c93339cd323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Created volume successfully. Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-d074f82e-cea0-493d-92f3-e2c82f9bab1e-a5f220c0-2b19-444a-a90d-c63769352cfa" by "_create_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-d074f82e-cea0-493d-92f3-e2c82f9bab1e-a5f220c0-2b19-444a-a90d-c63769352cfa" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Creating volume a5f220c0-2b19-444a-a90d-c63769352cfa from snapshot d074f82e-cea0-493d-92f3-e2c82f9bab1e {{(pid=82240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-a5f220c0-2b19-444a-a90d-c63769352cfa" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-a5f220c0-2b19-444a-a90d-c63769352cfa" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] snapshot: d074f82e-cea0-493d-92f3-e2c82f9bab1e, volume: a5f220c0-2b19-444a-a90d-c63769352cfa, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3851e99-8d8a-4993-8ca3-25c2f07df411]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:50 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e Apr 20 17:07:50 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:51 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e" returned: 0 in 0.726s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aab9c9-4205-402b-948f-0c4e4ac40471]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:51 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 Apr 20 17:07:51 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:51 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" returned: 0 in 0.636s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:07:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:51 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa Apr 20 17:07:51 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:54 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa" returned: 0 in 2.569s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:54 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2e5ac5-cce2-40bc-9ca8-79380f385597]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:54 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 Apr 20 17:07:54 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:55 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" returned: 0 in 0.822s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139, size 1024.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:07:55 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Converted 1024.00 MB image at 398.48 MB/s Apr 20 17:07:55 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:55 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa Apr 20 17:07:55 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:55 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa" returned: 0 in 0.471s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-a5f220c0-2b19-444a-a90d-c63769352cfa" released by "_copy_volume_from_snapshot" :: held 5.290s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-d074f82e-cea0-493d-92f3-e2c82f9bab1e-a5f220c0-2b19-444a-a90d-c63769352cfa" released by "_create_volume_from_snapshot" :: held 5.328s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.339s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.596s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Creating offline snapshot c4949fa8-624a-4fd0-a36f-d76ef5ffe468 of volume bbf6ffb9-8bfa-4111-97ef-737d0acbe12f {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8957f423-48f5-41a2-93f6-dd536a573ccf]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:55 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3e7deaa3-7fce-4287-a627-670192628fb2 tempest-GroupSnapshotsTest-1138843432 None] Create group from source-snapshot-f13f17e5-282d-4f00-964f-433c93aa342c completed successfully. Apr 20 17:07:55 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f Apr 20 17:07:55 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-a5f220c0-2b19-444a-a90d-c63769352cfa" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-a5f220c0-2b19-444a-a90d-c63769352cfa" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:56 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5a0f30-2c72-494a-ba9e-822488ee37b8]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:56 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" returned: 0 in 0.724s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:56 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa Apr 20 17:07:56 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:56 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 1G Apr 20 17:07:56 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:57 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa" returned: 0 in 0.711s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:57 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa Apr 20 17:07:57 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:57 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 1G" returned: 0 in 0.647s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:57 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 Apr 20 17:07:57 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:57 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468" returned: 0 in 0.565s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:57 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 is being set with open permissions: ugo+rw Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:57 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 Apr 20 17:07:57 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:57 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a5f220c0-2b19-444a-a90d-c63769352cfa" returned: 0 in 0.664s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-a5f220c0-2b19-444a-a90d-c63769352cfa" released by "delete_volume" :: held 1.401s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['0c9df0d5-ff4b-44f1-9893-d44aac606d2f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:57 devstack cinder-volume[82240]: WARNING cinder.quota [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-923319258 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-923319258, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:07:57 devstack cinder-volume[82240]: WARNING cinder.quota [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-923319258 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-923319258, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['14587716-3e9f-4cd6-8146-6c6da1628008', '0e9e810f-ff04-41ff-9f12-2a171943027a', 'f224774e-397f-41e7-938d-ac6b47c00305', '52ccc1d4-9697-48b5-88de-f05797fa0042'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:57 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:07:57 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:58 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468" returned: 0 in 0.527s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:58 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.info Apr 20 17:07:58 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (72444d80-2b7e-4ff2-89bf-93812ef327f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ce77a7-62e7-4f24-ad45-9fa9dc55adb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ce77a7-62e7-4f24-ad45-9fa9dc55adb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1815050953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6018ce8-a1a3-4959-b15e-c693f85e6c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30af806587dc4012ad410983fb8d754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:58Z,use_quota=True,user_id='0722c8b4fbdd4c3db7f91988ec494e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967b4a89-6d19-4c94-8b9e-dd7c4c0e54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967b4a89-6d19-4c94-8b9e-dd7c4c0e54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d162deeb-b50f-4e3e-8faa-b7d2156f0c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d162deeb-b50f-4e3e-8faa-b7d2156f0c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6018ce8-a1a3-4959-b15e-c693f85e6c16', 'volume_name': 'volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d926312-4683-4a69-a4bb-37def81d8cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d926312-4683-4a69-a4bb-37def81d8cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455cc8d5-47cd-43c6-910f-806a8fa90f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:07:58 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume d6018ce8-a1a3-4959-b15e-c693f85e6c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16', 'volume_size': 1} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:58 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.513s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:07:58 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8e2e26c4-4dc7-49bf-bf8c-ef3e2954eb34 tempest-GroupSnapshotsTest-1138843432 None] Delete group completed successfully. Apr 20 17:07:58 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] group_snapshot f13f17e5-282d-4f00-964f-433c93aa342c: deleting Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] group_snapshot f13f17e5-282d-4f00-964f-433c93aa342c: deleting {{(pid=82240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-d074f82e-cea0-493d-92f3-e2c82f9bab1e" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-d074f82e-cea0-493d-92f3-e2c82f9bab1e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Deleting offline snapshot d074f82e-cea0-493d-92f3-e2c82f9bab1e of volume f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] snapshot_file for this snap is: volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a834c8-ab43-4df3-93be-27eea9a2b7c7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:58 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e Apr 20 17:07:58 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:58 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.info" returned: 0 in 0.530s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:58 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.info is being set with open permissions: ugo+rw Apr 20 17:07:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:58 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.info Apr 20 17:07:58 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:59 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e" returned: 0 in 0.507s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5ee97c-ed2d-4db9-8ee1-781b55c1c3ab]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:59 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 Apr 20 17:07:59 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:59 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.info" returned: 0 in 0.479s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.593s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1815050953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6018ce8-a1a3-4959-b15e-c693f85e6c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30af806587dc4012ad410983fb8d754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:07:58Z,use_quota=True,user_id='0722c8b4fbdd4c3db7f91988ec494e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Creating volume d6018ce8-a1a3-4959-b15e-c693f85e6c16 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:07:59 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:59 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 1073741824 Apr 20 17:07:59 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:59 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-431deeb2-2a94-4343-a706-b2a07d909df5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Create snapshot completed successfully Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "cinder-c4949fa8-624a-4fd0-a36f-d76ef5ffe468-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-c4949fa8-624a-4fd0-a36f-d76ef5ffe468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "cinder-quobyte-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-quobyte-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "cinder-quobyte-c4949fa8-624a-4fd0-a36f-d76ef5ffe468" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-quobyte-c4949fa8-624a-4fd0-a36f-d76ef5ffe468" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Deleting offline snapshot c4949fa8-624a-4fd0-a36f-d76ef5ffe468 of volume bbf6ffb9-8bfa-4111-97ef-737d0acbe12f {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] snapshot_file for this snap is: volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861d8a2-b6b5-4f5c-aae5-a257d10cb903]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:07:59 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" returned: 0 in 0.619s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:59 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 1073741824" returned: 0 in 0.555s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:07:59 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e Apr 20 17:07:59 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:07:59 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 Apr 20 17:07:59 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:07:59 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 Apr 20 17:07:59 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:00 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16" returned: 0 in 0.469s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455cc8d5-47cd-43c6-910f-806a8fa90f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fb1ad2-234b-4eb2-a0d4-8e9cd93f78b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:00 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 (d6018ce8-a1a3-4959-b15e-c693f85e6c16): created successfully Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fb1ad2-234b-4eb2-a0d4-8e9cd93f78b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (72444d80-2b7e-4ff2-89bf-93812ef327f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:00 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ca5d9924-324a-4bd4-84e0-5666e49d7d27 tempest-VolumesSnapshotTestJSON-1605456745 None] Created volume successfully. Apr 20 17:08:00 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e" returned: 0 in 0.567s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:00 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e Apr 20 17:08:00 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:00 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468" returned: 0 in 0.698s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[53324838-5ccd-4732-a152-1d1a83c9f0dd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:00 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f Apr 20 17:08:00 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Creating offline snapshot 0b048683-ffb8-44a0-b91a-024672e5e038 of volume d6018ce8-a1a3-4959-b15e-c693f85e6c16 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e87ae5e-5edf-49a0-8a67-eaeef243d74d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:00 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 Apr 20 17:08:00 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:01 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139.d074f82e-cea0-493d-92f3-e2c82f9bab1e" returned: 0 in 0.611s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-d074f82e-cea0-493d-92f3-e2c82f9bab1e" released by "_delete_snapshot" :: held 2.353s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" released by "delete_snapshot" :: held 2.364s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:01 devstack cinder-volume[82240]: WARNING cinder.quota [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-923319258 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-923319258, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['0156d7a7-3492-4ecd-9c5e-73aa38ed8c1f', '525dea10-a7f7-447f-b255-a658de3b83a7', '0f65b578-41be-46b7-be04-1ed35cfcfd90', '8df14684-2152-4108-b178-a750a226fe43'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:01 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f5ca6a4c-bd40-4a5a-8d25-cee0c36a972b tempest-GroupSnapshotsTest-1138843432 None] group_snapshot f13f17e5-282d-4f00-964f-433c93aa342c: deleted successfully Apr 20 17:08:01 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" returned: 0 in 0.717s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:01 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 Apr 20 17:08:01 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:01 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16" returned: 0 in 0.598s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:01 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 1G Apr 20 17:08:01 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:01 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468" returned: 0 in 0.578s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:01 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468 Apr 20 17:08:01 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:01 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 1G" returned: 0 in 0.597s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:01 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 Apr 20 17:08:01 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e0156b-d0ef-46a1-bbf2-8eaa0d645f48]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:02 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 Apr 20 17:08:02 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:02 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038" returned: 0 in 0.515s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:02 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 is being set with open permissions: ugo+rw Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:02 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 Apr 20 17:08:02 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:02 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f.c4949fa8-624a-4fd0-a36f-d76ef5ffe468" returned: 0 in 0.740s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-quobyte-c4949fa8-624a-4fd0-a36f-d76ef5ffe468" released by "_delete_snapshot" :: held 2.809s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-quobyte-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" released by "delete_snapshot" :: held 2.827s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Created reservations ['7901847c-c0cf-4087-9ed5-e86b3c68c357', '1f471b58-0196-4e5b-8843-309b4a52cff2', '7c9b50ad-c2c5-4323-8b5b-61f912a0a79d', '71d318aa-b454-4290-a56e-ba112a6b404b'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:02 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Delete snapshot completed successfully. Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73d71789-8775-4100-86ea-8f8f2cdf81b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-c4949fa8-624a-4fd0-a36f-d76ef5ffe468-delete_snapshot" released by "delete_snapshot" :: held 3.018s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:02 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" returned: 0 in 0.633s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:02 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139 Apr 20 17:08:02 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:02 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038" returned: 0 in 0.485s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:03 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.info Apr 20 17:08:03 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "cinder-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "cinder-quobyte-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-quobyte-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722e424-b2c4-4c75-b9ed-61d42ca1a0f5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:03 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f Apr 20 17:08:03 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:03 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" returned: 0 in 0.595s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-f6b864b0-2a5b-4f78-a82b-e787ca0c1139" released by "delete_volume" :: held 1.263s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['0ed5369c-591d-48b0-9ee3-3abd73eeae74'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:03 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.info" returned: 0 in 0.536s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:03 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.info is being set with open permissions: ugo+rw Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:03 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.info Apr 20 17:08:03 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:03 devstack cinder-volume[82240]: WARNING cinder.db.sqlalchemy.api [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-923319258'] Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['9bcd2630-8a07-45f8-9eef-7c41fcb579b4', 'ebe8a228-021e-486e-a281-df2c9f7b0789', '00d89c7d-4727-45cd-a469-b661ea68011f', '9d99dba1-12d5-425e-ad8c-f041a51fd3fc'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:03 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:03 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:03 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" returned: 0 in 0.628s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:03 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f Apr 20 17:08:03 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:03 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.info" returned: 0 in 0.484s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.277s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ab6af803-a626-4669-b6be-d6a746da533c tempest-VolumesSnapshotTestJSON-1605456745 None] Create snapshot completed successfully Apr 20 17:08:04 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.683s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-6b804cfb-2ac1-4520-8007-044b1dfec0b9 tempest-GroupSnapshotsTest-1138843432 None] Delete group completed successfully. Apr 20 17:08:04 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" returned: 0 in 0.537s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-quobyte-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f" released by "delete_volume" :: held 1.218s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Created reservations ['9146dc66-9b64-462d-bced-86e0c00532de', 'db60be27-35f3-45d9-9fd6-2434aa31041b', '72114a92-ea9b-4196-ba00-43a92980baba', 'c9a48250-3443-4b32-afed-607e2cfe3b49'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:04 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:04 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b102d31a-8bf0-4ccc-b00d-a0824a4712de tempest-GroupSnapshotsTest-1138843432 None] Group tempest-GroupSnapshotsTest-Group-1689487662: creating Apr 20 17:08:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b102d31a-8bf0-4ccc-b00d-a0824a4712de tempest-GroupSnapshotsTest-1138843432 None] Group tempest-GroupSnapshotsTest-Group-1689487662: created successfully Apr 20 17:08:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b102d31a-8bf0-4ccc-b00d-a0824a4712de tempest-GroupSnapshotsTest-1138843432 None] Create group completed successfully. Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-0b048683-ffb8-44a0-b91a-024672e5e038-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-0b048683-ffb8-44a0-b91a-024672e5e038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:05 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.595s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:05 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Deleted volume successfully. Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-d6018ce8-a1a3-4959-b15e-c693f85e6c16" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1a2ba106-58b7-4617-ba08-ed4816551d95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1424352461 None] Lock "cinder-bbf6ffb9-8bfa-4111-97ef-737d0acbe12f-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-d6018ce8-a1a3-4959-b15e-c693f85e6c16" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-0b048683-ffb8-44a0-b91a-024672e5e038" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-0b048683-ffb8-44a0-b91a-024672e5e038" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Deleting offline snapshot 0b048683-ffb8-44a0-b91a-024672e5e038 of volume d6018ce8-a1a3-4959-b15e-c693f85e6c16 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] snapshot_file for this snap is: volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de077db-b884-4305-9c71-a260897a482e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:05 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 Apr 20 17:08:05 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:05 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038" returned: 0 in 0.596s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[16299930-65b7-4e3f-a0be-eccf9642749a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:05 devstack sudo[86933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 Apr 20 17:08:05 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Flow 'volume_create_manager' (6a2b88b4-d1d1-44fc-ad70-bf282506a91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76745afe-5f86-481a-9b19-b67a948d64fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76745afe-5f86-481a-9b19-b67a948d64fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1812485312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e7f9a5f-a023-4802-9f54-31c390e8a993,host='devstack@QuobyteHD#QuobyteHD',id=5faf42e7-e37f-43b5-af80-4c6d3e29b3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b894766013a7425ead4b55c74f68e99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:06Z,use_quota=True,user_id='823dab3fc04548648007022d1de9ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1419ee9d-c7cc-40ba-bb6b-15b534bd2c8f),volume_type_id=1419ee9d-c7cc-40ba-bb6b-15b534bd2c8f)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b262a50-ac43-44fe-8057-71c4d8a5d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b262a50-ac43-44fe-8057-71c4d8a5d829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffd9933-2d0d-488f-bf64-abbfed51339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffd9933-2d0d-488f-bf64-abbfed51339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5faf42e7-e37f-43b5-af80-4c6d3e29b3db', 'volume_name': 'volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8840e5a1-3386-4d55-bbb5-188296dc415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8840e5a1-3386-4d55-bbb5-188296dc415c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ca015b-ef44-414a-bf02-3dd96c245342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Volume 5faf42e7-e37f-43b5-af80-4c6d3e29b3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db', 'volume_size': 1} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e7f9a5f-a023-4802-9f54-31c390e8a993,created_at=2026-04-20T15:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1812485312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e7f9a5f-a023-4802-9f54-31c390e8a993,host='devstack@QuobyteHD#QuobyteHD',id=5faf42e7-e37f-43b5-af80-4c6d3e29b3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b894766013a7425ead4b55c74f68e99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:06Z,use_quota=True,user_id='823dab3fc04548648007022d1de9ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1419ee9d-c7cc-40ba-bb6b-15b534bd2c8f),volume_type_id=1419ee9d-c7cc-40ba-bb6b-15b534bd2c8f)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Creating volume 5faf42e7-e37f-43b5-af80-4c6d3e29b3db {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:06 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:06 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db 1073741824 Apr 20 17:08:06 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:06 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16" returned: 0 in 0.667s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:06 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 Apr 20 17:08:06 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:06 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db 1073741824" returned: 0 in 0.613s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:06 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db Apr 20 17:08:06 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:07 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038" returned: 0 in 0.597s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:07 devstack sudo[86951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038 Apr 20 17:08:07 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:07 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" returned: 0 in 0.479s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ca015b-ef44-414a-bf02-3dd96c245342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743aaa30-268c-4b2b-a36d-420fdcc3f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:07 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Volume volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db (5faf42e7-e37f-43b5-af80-4c6d3e29b3db): created successfully Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743aaa30-268c-4b2b-a36d-420fdcc3f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Flow 'volume_create_manager' (6a2b88b4-d1d1-44fc-ad70-bf282506a91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0d93a1b7-99fb-4560-8794-807696f61766 tempest-GroupSnapshotsTest-1138843432 None] Created volume successfully. Apr 20 17:08:07 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16.0b048683-ffb8-44a0-b91a-024672e5e038" returned: 0 in 0.521s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-0b048683-ffb8-44a0-b91a-024672e5e038" released by "_delete_snapshot" :: held 2.460s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-d6018ce8-a1a3-4959-b15e-c693f85e6c16" released by "delete_snapshot" :: held 2.473s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Created reservations ['4a41d221-f0ae-4cbb-881c-5a6cced2b640', 'b41696fb-57d8-4d9b-b6bb-f53e2283e9b3', '22a692fb-edd5-48e6-a78e-642446eff81e', '52a831a9-0ed9-4ef7-9ab3-22b7f4b7e698'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Delete snapshot completed successfully. Apr 20 17:08:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3d455d0e-7149-4189-ad12-132444a0c00d tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-0b048683-ffb8-44a0-b91a-024672e5e038-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (ce96afa9-cbcb-41f2-bb47-cb32c7912367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f213b88-b287-45dc-89ab-333dc5cbdd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f213b88-b287-45dc-89ab-333dc5cbdd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1845401499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f408b2-1066-474a-9263-e3f0ea184d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30af806587dc4012ad410983fb8d754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:09Z,use_quota=True,user_id='0722c8b4fbdd4c3db7f91988ec494e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17dd707-5969-4bf0-a9cd-bda87c464a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17dd707-5969-4bf0-a9cd-bda87c464a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca4ad2-e345-4558-bf71-bda552cee44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca4ad2-e345-4558-bf71-bda552cee44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f408b2-1066-474a-9263-e3f0ea184d9b', 'volume_name': 'volume-53f408b2-1066-474a-9263-e3f0ea184d9b', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fad60b-7cd1-4be9-acac-d42c4e2a10e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fad60b-7cd1-4be9-acac-d42c4e2a10e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dab443-49b7-46c0-a03b-4fa264fc3043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Volume 53f408b2-1066-474a-9263-e3f0ea184d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f408b2-1066-474a-9263-e3f0ea184d9b', 'volume_size': 1} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1845401499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f408b2-1066-474a-9263-e3f0ea184d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30af806587dc4012ad410983fb8d754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:09Z,use_quota=True,user_id='0722c8b4fbdd4c3db7f91988ec494e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Creating volume 53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:08 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:08 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b 1073741824 Apr 20 17:08:08 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Flow 'volume_create_manager' (168e7d12-9d8a-44d7-9315-586f8db2a1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f955ad4-6f21-4d1a-a489-d830bbd1cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f955ad4-6f21-4d1a-a489-d830bbd1cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1710043803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e7f9a5f-a023-4802-9f54-31c390e8a993,host='devstack@QuobyteHD#QuobyteHD',id=b16c40f5-1d80-4b29-8814-632cba22e6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b894766013a7425ead4b55c74f68e99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:09Z,use_quota=True,user_id='823dab3fc04548648007022d1de9ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1419ee9d-c7cc-40ba-bb6b-15b534bd2c8f),volume_type_id=1419ee9d-c7cc-40ba-bb6b-15b534bd2c8f)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195f6e45-700a-47ca-a656-56e64944e8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195f6e45-700a-47ca-a656-56e64944e8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763a427e-569b-4eca-a355-9e55bb68439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763a427e-569b-4eca-a355-9e55bb68439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16c40f5-1d80-4b29-8814-632cba22e6f4', 'volume_name': 'volume-b16c40f5-1d80-4b29-8814-632cba22e6f4', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7825a65b-20fd-4ac9-8adc-02e23ec71b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7825a65b-20fd-4ac9-8adc-02e23ec71b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71100137-f260-45c0-aca6-381b6266862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:08 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Volume b16c40f5-1d80-4b29-8814-632cba22e6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16c40f5-1d80-4b29-8814-632cba22e6f4', 'volume_size': 1} Apr 20 17:08:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:09 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b 1073741824" returned: 0 in 0.617s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:09 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b Apr 20 17:08:09 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:09 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b" returned: 0 in 0.445s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e7f9a5f-a023-4802-9f54-31c390e8a993,created_at=2026-04-20T15:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1710043803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e7f9a5f-a023-4802-9f54-31c390e8a993,host='devstack@QuobyteHD#QuobyteHD',id=b16c40f5-1d80-4b29-8814-632cba22e6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b894766013a7425ead4b55c74f68e99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:09Z,use_quota=True,user_id='823dab3fc04548648007022d1de9ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1419ee9d-c7cc-40ba-bb6b-15b534bd2c8f),volume_type_id=1419ee9d-c7cc-40ba-bb6b-15b534bd2c8f)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Creating volume b16c40f5-1d80-4b29-8814-632cba22e6f4 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:09 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:09 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 1073741824 Apr 20 17:08:09 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dab443-49b7-46c0-a03b-4fa264fc3043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f408b2-1066-474a-9263-e3f0ea184d9b', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120526f8-d40b-415a-a3d7-0cedb429c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:09 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Volume volume-53f408b2-1066-474a-9263-e3f0ea184d9b (53f408b2-1066-474a-9263-e3f0ea184d9b): created successfully Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120526f8-d40b-415a-a3d7-0cedb429c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (ce96afa9-cbcb-41f2-bb47-cb32c7912367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-37b81066-ddd7-40bc-bd8a-6fd79a2c4fac tempest-VolumesSnapshotTestJSON-1605456745 None] Created volume successfully. Apr 20 17:08:10 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 1073741824" returned: 0 in 0.600s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=200,cinder:SELECT=159,cinder:INSERT=60,cinder:DELETE=12 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:10 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 Apr 20 17:08:10 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:10 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4" returned: 0 in 0.556s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.085s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71100137-f260-45c0-aca6-381b6266862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16c40f5-1d80-4b29-8814-632cba22e6f4', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bccf45b-db4e-4000-8e60-32cb949b2fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Creating offline snapshot 1d910bc6-e4af-4347-8509-34f6ca682e58 of volume 53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:08:11 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Volume volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 (b16c40f5-1d80-4b29-8814-632cba22e6f4): created successfully Apr 20 17:08:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bccf45b-db4e-4000-8e60-32cb949b2fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Flow 'volume_create_manager' (168e7d12-9d8a-44d7-9315-586f8db2a1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:11 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4febfd7e-3edd-4372-8a12-9e7dcb54781c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:11 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-711a67cc-33b0-4f21-9098-99738026a315 tempest-GroupSnapshotsTest-1138843432 None] Created volume successfully. Apr 20 17:08:11 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b Apr 20 17:08:11 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:11 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b" returned: 0 in 0.637s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:11 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 1G Apr 20 17:08:11 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:12 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-db8dc56a-0a7d-45b4-b0c0-77e05d54e6c1 tempest-GroupSnapshotsTest-1138843432 None] Update group completed successfully. Apr 20 17:08:12 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 1G" returned: 0 in 0.577s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f408b2-1066-474a-9263-e3f0ea184d9b -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:12 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f408b2-1066-474a-9263-e3f0ea184d9b -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 Apr 20 17:08:12 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:12 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f408b2-1066-474a-9263-e3f0ea184d9b -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58" returned: 0 in 0.557s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:12 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 is being set with open permissions: ugo+rw Apr 20 17:08:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:12 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 Apr 20 17:08:12 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:13 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:13 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-873e68f6-4533-484b-9994-54f2d1db6c36 tempest-GroupSnapshotsTest-1138843432 None] Update group completed successfully. Apr 20 17:08:13 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.info Apr 20 17:08:13 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:13 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.info" returned: 0 in 0.559s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:13 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.info is being set with open permissions: ugo+rw Apr 20 17:08:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:13 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.info Apr 20 17:08:13 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:14 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.info" returned: 0 in 0.463s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.420s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-15924782-95ab-4bc6-9cc3-878412357503 tempest-VolumesSnapshotTestJSON-1605456745 None] Create snapshot completed successfully Apr 20 17:08:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0319c87b-e7d0-456a-b454-1d11568ac8bd tempest-GroupSnapshotsTest-1138843432 None] Update group completed successfully. Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Flow 'volume_create_manager' (6060c95e-56b1-4528-a2a5-3cecbd274097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8d4540-e929-4509-b86a-6e1851953bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8d4540-e929-4509-b86a-6e1851953bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-932613452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008796f1-902a-4cf0-b742-10b9a9be8e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d099047a744bab88f358d65649af4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:15Z,use_quota=True,user_id='c36d1d37d7f949608211db3a4bbac325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3575431f-9062-4497-8edd-08b996d5ef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3575431f-9062-4497-8edd-08b996d5ef0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdc7f91-df09-45d1-a289-1dc27c34e4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdc7f91-df09-45d1-a289-1dc27c34e4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '008796f1-902a-4cf0-b742-10b9a9be8e57', 'volume_name': 'volume-008796f1-902a-4cf0-b742-10b9a9be8e57', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f67577-718d-41be-94ce-0717396e88ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f67577-718d-41be-94ce-0717396e88ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d57533-2d55-449d-8bfb-03bdda70fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:14 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Volume 008796f1-902a-4cf0-b742-10b9a9be8e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-008796f1-902a-4cf0-b742-10b9a9be8e57', 'volume_size': 1} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-932613452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008796f1-902a-4cf0-b742-10b9a9be8e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d099047a744bab88f358d65649af4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:15Z,use_quota=True,user_id='c36d1d37d7f949608211db3a4bbac325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Creating volume 008796f1-902a-4cf0-b742-10b9a9be8e57 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:14 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:14 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 1073741824 Apr 20 17:08:14 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (61a2a02e-211e-4c3d-93ca-4f9f8be3be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dfd027-9507-43b9-ba5d-6f38993dd2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dfd027-9507-43b9-ba5d-6f38993dd2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880828147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b3cef4-9268-4998-8667-48eaf419ade6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30af806587dc4012ad410983fb8d754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1d910bc6-e4af-4347-8509-34f6ca682e58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:15Z,use_quota=True,user_id='0722c8b4fbdd4c3db7f91988ec494e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e470fe-d3a8-4ef5-9050-1bc4161373fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e470fe-d3a8-4ef5-9050-1bc4161373fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf28efd-e745-4ef4-a9a8-180118ae28c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf28efd-e745-4ef4-a9a8-180118ae28c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8b3cef4-9268-4998-8667-48eaf419ade6', 'volume_name': 'volume-f8b3cef4-9268-4998-8667-48eaf419ade6', 'volume_size': 2, 'snapshot_id': '1d910bc6-e4af-4347-8509-34f6ca682e58'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a448ca-0f08-44ed-b928-1cf2fc78766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a448ca-0f08-44ed-b928-1cf2fc78766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3937a7a4-c52a-4b1c-b89c-74ad8025767b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:15 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume f8b3cef4-9268-4998-8667-48eaf419ade6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8b3cef4-9268-4998-8667-48eaf419ade6', 'volume_size': 2, 'snapshot_id': '1d910bc6-e4af-4347-8509-34f6ca682e58'} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:15 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 1073741824" returned: 0 in 0.593s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:15 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 Apr 20 17:08:15 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:15 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-6330196e-5a25-4b19-b341-77dabc9792ea tempest-GroupSnapshotsTest-1138843432 None] Update group completed successfully. Apr 20 17:08:15 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57" returned: 0 in 0.418s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.470s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-1d910bc6-e4af-4347-8509-34f6ca682e58-f8b3cef4-9268-4998-8667-48eaf419ade6" by "_create_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d57533-2d55-449d-8bfb-03bdda70fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-008796f1-902a-4cf0-b742-10b9a9be8e57', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3392d4-7cca-4643-8f01-9c332155b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:15 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Volume volume-008796f1-902a-4cf0-b742-10b9a9be8e57 (008796f1-902a-4cf0-b742-10b9a9be8e57): created successfully Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3392d4-7cca-4643-8f01-9c332155b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Flow 'volume_create_manager' (6060c95e-56b1-4528-a2a5-3cecbd274097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-1d910bc6-e4af-4347-8509-34f6ca682e58-f8b3cef4-9268-4998-8667-48eaf419ade6" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Creating volume f8b3cef4-9268-4998-8667-48eaf419ade6 from snapshot 1d910bc6-e4af-4347-8509-34f6ca682e58 {{(pid=82240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-f8b3cef4-9268-4998-8667-48eaf419ade6" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:15 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b3b94752-d879-4de8-8a55-874437d92430 tempest-VolumesTransfersTest-1187338843 None] Created volume successfully. Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-f8b3cef4-9268-4998-8667-48eaf419ade6" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] snapshot: 1d910bc6-e4af-4347-8509-34f6ca682e58, volume: f8b3cef4-9268-4998-8667-48eaf419ade6, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6671b2a4-29e2-4ffd-a81a-d553ed210954]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:16 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 Apr 20 17:08:16 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:16 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58" returned: 0 in 0.777s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:16 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f408b2-1066-474a-9263-e3f0ea184d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:16 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:08:16 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:08:16 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-536fb94d-cc57-4934-900c-bba719190811 tempest-VolumesTransfersTest-1625319032 None] Transfer volume completed successfully. Apr 20 17:08:16 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf72a9b-a13d-4388-bb83-b7112a3d730e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:16 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b Apr 20 17:08:16 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:16 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] GroupSnapshot a0942b85-eaaf-4bb4-8a27-a9de6604825d: creating. Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Group snapshot a0942b85-eaaf-4bb4-8a27-a9de6604825d: creating. {{(pid=82240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Acquiring lock "cinder-008796f1-902a-4cf0-b742-10b9a9be8e57-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:17 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Lock "cinder-008796f1-902a-4cf0-b742-10b9a9be8e57-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b" returned: 0 in 0.820s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:17 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 Apr 20 17:08:17 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Acquiring lock "cinder-quobyte-008796f1-902a-4cf0-b742-10b9a9be8e57" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Lock "cinder-quobyte-008796f1-902a-4cf0-b742-10b9a9be8e57" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5634048-04d3-489b-bd26-583590e4969c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:17 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 Apr 20 17:08:17 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:18 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57" returned: 0 in 0.790s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:18 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57 Apr 20 17:08:18 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:20 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-008796f1-902a-4cf0-b742-10b9a9be8e57" returned: 0 in 1.566s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Lock "cinder-quobyte-008796f1-902a-4cf0-b742-10b9a9be8e57" released by "delete_volume" :: held 2.400s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Created reservations ['294aaaef-d5a7-4a4c-865b-c61c4d972e92', 'a03a8613-bce0-4e07-9fd9-5fb12a16271b', '5f4e0980-fdd7-4a82-a824-3863d3b3aecc', 'e287bc7c-bd0b-4891-83f9-a595fceac5d9'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:20 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6" returned: 0 in 2.736s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e11c06-63e8-4dd1-a773-7232f7ca0471]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:20 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:20 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:20 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b Apr 20 17:08:20 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (8d53dd93-e8b1-490d-a8a8-0fca25e48b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55539234-018e-4cbc-a02c-6da5df5d2620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55539234-018e-4cbc-a02c-6da5df5d2620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-464310136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78b745b-1571-4f8c-8f0c-6e003e6f58df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:20Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80310cf6-9349-4ef6-a50d-637d812ae6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80310cf6-9349-4ef6-a50d-637d812ae6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51150ab7-9975-4d13-94b8-3ec833ade2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51150ab7-9975-4d13-94b8-3ec833ade2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78b745b-1571-4f8c-8f0c-6e003e6f58df', 'volume_name': 'volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b01e5c-3bcc-40e3-8f97-8888f8b2641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b01e5c-3bcc-40e3-8f97-8888f8b2641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759e3355-db02-4732-82f3-9151742ed506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:20 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Volume f78b745b-1571-4f8c-8f0c-6e003e6f58df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df', 'volume_size': 1} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:20 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.428s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Deleted volume successfully. Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-225de69f-40e9-4d28-9f31-ab45e399ff69 tempest-VolumesTransfersTest-1749292872 None] Lock "cinder-008796f1-902a-4cf0-b742-10b9a9be8e57-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:20 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b" returned: 0 in 0.608s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b, size 1024.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:08:20 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Converted 1024.00 MB image at 373.84 MB/s Apr 20 17:08:20 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 is being set with open permissions: ugo+rw Apr 20 17:08:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:20 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 Apr 20 17:08:20 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Flow 'volume_create_manager' (7eea7396-1d03-4ab6-944e-268bcdd49f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3001fd-b21e-48e4-9f10-a645c93ceaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3001fd-b21e-48e4-9f10-a645c93ceaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1872078432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3524905-77ab-42fd-94a3-02d92ca8e5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d099047a744bab88f358d65649af4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:21Z,use_quota=True,user_id='c36d1d37d7f949608211db3a4bbac325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9015b4-26da-4479-b456-57838ef4fcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9015b4-26da-4479-b456-57838ef4fcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f26c376-392c-4e8d-8645-b1de3bb2b289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f26c376-392c-4e8d-8645-b1de3bb2b289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3524905-77ab-42fd-94a3-02d92ca8e5da', 'volume_name': 'volume-c3524905-77ab-42fd-94a3-02d92ca8e5da', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478a9e10-3e6a-43e8-9721-adbba28e19a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478a9e10-3e6a-43e8-9721-adbba28e19a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e518afa8-d70b-4628-825d-cdab24cd3df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:21 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Volume c3524905-77ab-42fd-94a3-02d92ca8e5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3524905-77ab-42fd-94a3-02d92ca8e5da', 'volume_size': 1} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:21 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6" returned: 0 in 0.530s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-f8b3cef4-9268-4998-8667-48eaf419ade6" released by "_copy_volume_from_snapshot" :: held 5.553s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-1d910bc6-e4af-4347-8509-34f6ca682e58-f8b3cef4-9268-4998-8667-48eaf419ade6" released by "_create_volume_from_snapshot" :: held 5.572s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.607s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.455s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Creating offline snapshot 3f90d783-e91b-4339-8db4-9b3c2265ab6a of volume b16c40f5-1d80-4b29-8814-632cba22e6f4 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dac2788-6b99-4aaf-a9d9-bd0b838bf36b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3937a7a4-c52a-4b1c-b89c-74ad8025767b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b3cef4-9268-4998-8667-48eaf419ade6', 'volume_size': 2, 'snapshot_id': '1d910bc6-e4af-4347-8509-34f6ca682e58'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc73e44-000c-4d8c-9808-2097e99f6d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:21 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume volume-f8b3cef4-9268-4998-8667-48eaf419ade6 (f8b3cef4-9268-4998-8667-48eaf419ade6): created successfully Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc73e44-000c-4d8c-9808-2097e99f6d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (61a2a02e-211e-4c3d-93ca-4f9f8be3be5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:21 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f9c5e267-d663-48dc-9776-60bbdfb32760 tempest-VolumesSnapshotTestJSON-1605456745 None] Created volume successfully. Apr 20 17:08:21 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 Apr 20 17:08:21 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:21 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4" returned: 0 in 0.492s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:22 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a 1G Apr 20 17:08:22 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-f8b3cef4-9268-4998-8667-48eaf419ade6-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-f8b3cef4-9268-4998-8667-48eaf419ade6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-f8b3cef4-9268-4998-8667-48eaf419ade6" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-f8b3cef4-9268-4998-8667-48eaf419ade6" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3069f7-842d-47c1-a6d0-4565b58657f0]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:22 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 Apr 20 17:08:22 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:22 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a 1G" returned: 0 in 0.574s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:22 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a Apr 20 17:08:22 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:22 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6" returned: 0 in 0.490s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:22 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6 Apr 20 17:08:22 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:23 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a" returned: 0 in 0.471s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:23 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:23 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a Apr 20 17:08:23 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:23 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f8b3cef4-9268-4998-8667-48eaf419ade6" returned: 0 in 0.421s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-f8b3cef4-9268-4998-8667-48eaf419ade6" released by "delete_volume" :: held 0.937s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=179,cinder:INSERT=45,cinder:UPDATE=185,cinder:DELETE=13 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Created reservations ['065b38a1-9288-4fd2-96b4-11a10bf1734b', '450ab6c7-40c4-4131-b5c8-07fbc9fccc28', 'a8e34aae-286b-4b61-ae26-3d3693b483a5', 'd09499b0-6e45-47c0-8d53-d2724b541733'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:23 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:23 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-1d910bc6-e4af-4347-8509-34f6ca682e58-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-1d910bc6-e4af-4347-8509-34f6ca682e58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-53f408b2-1066-474a-9263-e3f0ea184d9b" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-53f408b2-1066-474a-9263-e3f0ea184d9b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-1d910bc6-e4af-4347-8509-34f6ca682e58" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-1d910bc6-e4af-4347-8509-34f6ca682e58" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Deleting offline snapshot 1d910bc6-e4af-4347-8509-34f6ca682e58 of volume 53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] snapshot_file for this snap is: volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9f19c4-a2b5-4a29-a974-6125e4bb689c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:23 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:23 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 Apr 20 17:08:23 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:23 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.info Apr 20 17:08:23 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:23 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.522s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:23 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Deleted volume successfully. Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ccb5d712-26ab-488a-bce0-8a0d6c1d1358 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-f8b3cef4-9268-4998-8667-48eaf419ade6-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:23 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f408b2-1066-474a-9263-e3f0ea184d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e877c5-18bb-4de5-806e-f0721df7f3d5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:24 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.info" returned: 0 in 0.473s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:24 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:24 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.info Apr 20 17:08:24 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:24 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b Apr 20 17:08:24 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:24 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.info" returned: 0 in 0.418s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Creating offline snapshot c8358e5e-48c1-4c86-9f60-91fc9a729b2b of volume 5faf42e7-e37f-43b5-af80-4c6d3e29b3db {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bacde24-ff23-4448-86c6-239baab2b632]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:24 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db Apr 20 17:08:24 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:24 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b" returned: 0 in 0.615s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:24 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 Apr 20 17:08:24 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:25 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" returned: 0 in 0.541s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:25 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b 1G Apr 20 17:08:25 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:25 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58" returned: 0 in 0.502s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:25 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58 Apr 20 17:08:25 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:25 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b.1d910bc6-e4af-4347-8509-34f6ca682e58" returned: 0 in 0.568s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:25 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b 1G" returned: 0 in 0.645s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-1d910bc6-e4af-4347-8509-34f6ca682e58" released by "_delete_snapshot" :: held 2.297s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-53f408b2-1066-474a-9263-e3f0ea184d9b" released by "delete_snapshot" :: held 2.314s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:25 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b Apr 20 17:08:25 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Created reservations ['2b37fe8e-c187-4e47-ad8c-86cfe4bada57', '1eb22c8c-6a47-4b8f-ba53-6123f2020fe8', '49f6da9e-e24a-4fc4-915a-dec83fb58e69', 'd73b9fbb-ea99-4fe5-8012-548d70fed61b'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Delete snapshot completed successfully. Apr 20 17:08:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-19995a92-1ba3-4f55-835d-fca762154c55 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-1d910bc6-e4af-4347-8509-34f6ca682e58-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:26 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b" returned: 0 in 0.459s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:26 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:26 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b Apr 20 17:08:26 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:26 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b" returned: 0 in 0.423s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:26 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.info Apr 20 17:08:26 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-53f408b2-1066-474a-9263-e3f0ea184d9b-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-53f408b2-1066-474a-9263-e3f0ea184d9b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-53f408b2-1066-474a-9263-e3f0ea184d9b" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-53f408b2-1066-474a-9263-e3f0ea184d9b" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1141c8d1-f494-4375-819a-609b57745427]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:26 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b Apr 20 17:08:26 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:27 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.info" returned: 0 in 0.460s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:27 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.info is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:27 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.info Apr 20 17:08:27 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:27 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b" returned: 0 in 0.473s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:27 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b Apr 20 17:08:27 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:27 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.info" returned: 0 in 0.417s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.066s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1872078432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3524905-77ab-42fd-94a3-02d92ca8e5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d099047a744bab88f358d65649af4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:21Z,use_quota=True,user_id='c36d1d37d7f949608211db3a4bbac325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Creating volume c3524905-77ab-42fd-94a3-02d92ca8e5da {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:27 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:27 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da 1073741824 Apr 20 17:08:27 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:27 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9e4e2678-44a5-425b-ac68-ec6a18f8b75a tempest-GroupSnapshotsTest-1138843432 None] group_snapshot a0942b85-eaaf-4bb4-8a27-a9de6604825d: created successfully Apr 20 17:08:27 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-53f408b2-1066-474a-9263-e3f0ea184d9b" returned: 0 in 0.449s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-53f408b2-1066-474a-9263-e3f0ea184d9b" released by "delete_volume" :: held 0.983s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Created reservations ['db051abc-0172-4530-a87d-05810630e5cc', 'b8a0e7bf-3520-425e-a5ae-9cba1e3ba36b', 'bbf49567-ecf5-46cd-acc2-a2732e7ff777', 'cf057fca-cbb7-4dbd-91aa-d1b57846cf7d'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:27 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:27 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:28 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da 1073741824" returned: 0 in 0.556s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:28 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da Apr 20 17:08:28 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:28 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.436s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Deleted volume successfully. Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-122a87a0-7c8f-43d0-8c16-6a46778b3da8 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-53f408b2-1066-474a-9263-e3f0ea184d9b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:28 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da" returned: 0 in 0.427s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.035s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-464310136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78b745b-1571-4f8c-8f0c-6e003e6f58df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:20Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Creating volume f78b745b-1571-4f8c-8f0c-6e003e6f58df {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:28 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e518afa8-d70b-4628-825d-cdab24cd3df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3524905-77ab-42fd-94a3-02d92ca8e5da', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0ddc91-3f26-40ae-8cb3-5ec680fe5892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:28 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df 1073741824 Apr 20 17:08:28 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:28 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Volume volume-c3524905-77ab-42fd-94a3-02d92ca8e5da (c3524905-77ab-42fd-94a3-02d92ca8e5da): created successfully Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0ddc91-3f26-40ae-8cb3-5ec680fe5892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Flow 'volume_create_manager' (7eea7396-1d03-4ab6-944e-268bcdd49f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d1bf2aaa-4587-470c-b91a-902bea524c19 tempest-VolumesTransfersTest-1187338843 None] Created volume successfully. Apr 20 17:08:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] group_snapshot a0942b85-eaaf-4bb4-8a27-a9de6604825d: deleting Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] group_snapshot a0942b85-eaaf-4bb4-8a27-a9de6604825d: deleting {{(pid=82240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-b16c40f5-1d80-4b29-8814-632cba22e6f4" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-b16c40f5-1d80-4b29-8814-632cba22e6f4" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-3f90d783-e91b-4339-8db4-9b3c2265ab6a" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-3f90d783-e91b-4339-8db4-9b3c2265ab6a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Deleting offline snapshot 3f90d783-e91b-4339-8db4-9b3c2265ab6a of volume b16c40f5-1d80-4b29-8814-632cba22e6f4 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] snapshot_file for this snap is: volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3bc04e-9068-4114-84de-69ba9a14215b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:28 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a Apr 20 17:08:28 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Acquiring lock "cinder-c3524905-77ab-42fd-94a3-02d92ca8e5da-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Lock "cinder-c3524905-77ab-42fd-94a3-02d92ca8e5da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Acquiring lock "cinder-quobyte-c3524905-77ab-42fd-94a3-02d92ca8e5da" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:29 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Lock "cinder-quobyte-c3524905-77ab-42fd-94a3-02d92ca8e5da" acquired by "delete_volume" :: waited 0.029s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df 1073741824" returned: 0 in 0.827s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8437f3f5-35f3-457e-b7ca-28bd7a8a52ca]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:29 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a" returned: 0 in 0.740s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:29 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df Apr 20 17:08:29 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (b5d7b54a-d1e2-489d-8f6e-b88ecb3fcb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:29 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da Apr 20 17:08:29 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0780737b-c5b1-404c-9742-f36930b53322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16c40f5-1d80-4b29-8814-632cba22e6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b2c10-fc81-4c25-8ab0-07f140f85edd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0780737b-c5b1-404c-9742-f36930b53322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1454399354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70deae99-670b-4a2f-a82f-a7e424da2813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30af806587dc4012ad410983fb8d754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:29Z,use_quota=True,user_id='0722c8b4fbdd4c3db7f91988ec494e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1b0ae1-9352-4597-84d9-d721e0bc50df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1b0ae1-9352-4597-84d9-d721e0bc50df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0610b87a-6168-4756-8b2a-c3f820eb8dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0610b87a-6168-4756-8b2a-c3f820eb8dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70deae99-670b-4a2f-a82f-a7e424da2813', 'volume_name': 'volume-70deae99-670b-4a2f-a82f-a7e424da2813', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758f205d-c479-4f92-9ede-d49fd0b568b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758f205d-c479-4f92-9ede-d49fd0b568b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511b3f01-47a8-44f3-9ce7-63d9ebc70e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume 70deae99-670b-4a2f-a82f-a7e424da2813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70deae99-670b-4a2f-a82f-a7e424da2813', 'volume_size': 1} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:29 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 Apr 20 17:08:29 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:29 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df" returned: 0 in 0.462s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1454399354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70deae99-670b-4a2f-a82f-a7e424da2813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30af806587dc4012ad410983fb8d754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:29Z,use_quota=True,user_id='0722c8b4fbdd4c3db7f91988ec494e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Creating volume 70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:29 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759e3355-db02-4732-82f3-9151742ed506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:29 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cf17f5-1236-4737-a576-63bf348c2baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da" returned: 0 in 0.540s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:29 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 1073741824 Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:29 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Volume volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df (f78b745b-1571-4f8c-8f0c-6e003e6f58df): created successfully Apr 20 17:08:29 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da Apr 20 17:08:29 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cf17f5-1236-4737-a576-63bf348c2baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (8d53dd93-e8b1-490d-a8a8-0fca25e48b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:30 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-06c5dfcb-f9aa-49b1-8304-25fac96a9003 tempest-VolumesActionsTest-987572482 None] Created volume successfully. Apr 20 17:08:30 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:30 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8f19c4ac-dc7a-4f2a-bf0c-81f0f394e38c tempest-VolumesActionsTest-987572482 None] Acquiring lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df" by "attach_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8f19c4ac-dc7a-4f2a-bf0c-81f0f394e38c tempest-VolumesActionsTest-987572482 None] Lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df" acquired by "attach_volume" :: waited 0.040s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:30 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:30 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8f19c4ac-dc7a-4f2a-bf0c-81f0f394e38c tempest-VolumesActionsTest-987572482 None] Attaching volume f78b745b-1571-4f8c-8f0c-6e003e6f58df to instance d1ff74ee-1be8-414c-9cab-45eaf9e9ed1e at mountpoint /dev/vdb on host None. Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4" returned: 0 in 0.751s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:30 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a Apr 20 17:08:30 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:30 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8f19c4ac-dc7a-4f2a-bf0c-81f0f394e38c tempest-VolumesActionsTest-987572482 None] Attach volume completed successfully. Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8f19c4ac-dc7a-4f2a-bf0c-81f0f394e38c tempest-VolumesActionsTest-987572482 None] Lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df" released by "attach_volume" :: held 0.169s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:30 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c3524905-77ab-42fd-94a3-02d92ca8e5da" returned: 0 in 0.668s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Lock "cinder-quobyte-c3524905-77ab-42fd-94a3-02d92ca8e5da" released by "delete_volume" :: held 1.253s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Created reservations ['f3129954-c82d-4f6d-8786-c10c85549563', '3ea35a91-745f-4987-9282-737fcf2fe42d', 'af9fc9df-5323-411c-bff7-2872f7ffaa7e', '46383160-a279-4be7-af3b-22ca144f3360'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:30 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:30 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:30 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a" returned: 0 in 0.661s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:30 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a Apr 20 17:08:30 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:30 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.945s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:30 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 1073741824" returned: 0 in 1.093s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:31 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 Apr 20 17:08:31 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-859b2afa-e258-474a-848f-ede2313776a0 tempest-VolumesActionsTest-108170520 None] Terminate volume connection completed successfully. Apr 20 17:08:31 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.667s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Deleted volume successfully. Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e30ea71a-30bf-41e3-afb9-2e3e4ee114c8 tempest-VolumesTransfersTest-1749292872 None] Lock "cinder-c3524905-77ab-42fd-94a3-02d92ca8e5da-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:31 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4.3f90d783-e91b-4339-8db4-9b3c2265ab6a" returned: 0 in 0.565s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-3f90d783-e91b-4339-8db4-9b3c2265ab6a" released by "_delete_snapshot" :: held 2.805s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-b16c40f5-1d80-4b29-8814-632cba22e6f4" released by "delete_snapshot" :: held 2.818s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-c8358e5e-48c1-4c86-9f60-91fc9a729b2b" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-c8358e5e-48c1-4c86-9f60-91fc9a729b2b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Deleting offline snapshot c8358e5e-48c1-4c86-9f60-91fc9a729b2b of volume 5faf42e7-e37f-43b5-af80-4c6d3e29b3db {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] snapshot_file for this snap is: volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d86be91-aeb3-41da-8a40-f33180dc710e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:31 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813" returned: 0 in 0.563s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511b3f01-47a8-44f3-9ce7-63d9ebc70e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70deae99-670b-4a2f-a82f-a7e424da2813', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7c3862-6c59-4196-90b3-4b0524da031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:31 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Volume volume-70deae99-670b-4a2f-a82f-a7e424da2813 (70deae99-670b-4a2f-a82f-a7e424da2813): created successfully Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7c3862-6c59-4196-90b3-4b0524da031f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (b5d7b54a-d1e2-489d-8f6e-b88ecb3fcb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c471e2ad-5b37-4cd4-a458-fa145fb24f10 tempest-VolumesSnapshotTestJSON-1605456745 None] Created volume successfully. Apr 20 17:08:31 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b Apr 20 17:08:31 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-859b2afa-e258-474a-848f-ede2313776a0 tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-detach_volume" by "detach_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-859b2afa-e258-474a-848f-ede2313776a0 tempest-VolumesActionsTest-108170520 None] Lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-859b2afa-e258-474a-848f-ede2313776a0 tempest-VolumesActionsTest-108170520 None] Detaching volume f78b745b-1571-4f8c-8f0c-6e003e6f58df from instance d1ff74ee-1be8-414c-9cab-45eaf9e9ed1e. Apr 20 17:08:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-859b2afa-e258-474a-848f-ede2313776a0 tempest-VolumesActionsTest-108170520 None] Detach volume completed successfully. Apr 20 17:08:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-859b2afa-e258-474a-848f-ede2313776a0 tempest-VolumesActionsTest-108170520 None] Lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:32 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b" returned: 0 in 0.579s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3edb0cd-edde-4d23-b28e-2447c4b246ed]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:32 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db Apr 20 17:08:32 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7de5cc29-cb24-4916-a882-4bc012898e95 tempest-VolumesActionsTest-987572482 None] Acquiring lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-detach_volume" by "detach_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7de5cc29-cb24-4916-a882-4bc012898e95 tempest-VolumesActionsTest-987572482 None] Lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:32 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7de5cc29-cb24-4916-a882-4bc012898e95 tempest-VolumesActionsTest-987572482 None] Volume detach called, but volume not attached. Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7de5cc29-cb24-4916-a882-4bc012898e95 tempest-VolumesActionsTest-987572482 None] Lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Creating offline snapshot 97734273-dc50-4c02-9420-ba572267f73f of volume 70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97608da-9f4f-4e25-b2cc-df5c1b16fc58]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:32 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" returned: 0 in 0.724s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:32 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b Apr 20 17:08:32 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:32 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 Apr 20 17:08:32 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Acquiring lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Acquiring lock "cinder-quobyte-f78b745b-1571-4f8c-8f0c-6e003e6f58df" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Lock "cinder-quobyte-f78b745b-1571-4f8c-8f0c-6e003e6f58df" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[927a7448-da08-48cf-80fc-41989e76e7b6]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:33 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813" returned: 0 in 0.595s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:33 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df Apr 20 17:08:33 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:33 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f 1G Apr 20 17:08:33 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:33 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b" returned: 0 in 0.660s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:33 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b Apr 20 17:08:33 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:34 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f 1G" returned: 0 in 0.659s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70deae99-670b-4a2f-a82f-a7e424da2813 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:34 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70deae99-670b-4a2f-a82f-a7e424da2813 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f Apr 20 17:08:34 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:34 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df" returned: 0 in 0.863s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:34 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df Apr 20 17:08:34 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:34 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db.c8358e5e-48c1-4c86-9f60-91fc9a729b2b" returned: 0 in 0.837s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-c8358e5e-48c1-4c86-9f60-91fc9a729b2b" released by "_delete_snapshot" :: held 2.894s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" released by "delete_snapshot" :: held 2.906s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:34 devstack cinder-volume[82240]: WARNING cinder.quota [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-752792469 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-752792469, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:08:34 devstack cinder-volume[82240]: WARNING cinder.quota [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-752792469 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-752792469, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['e9be62aa-2942-464a-8943-5d5ac1e2ff65', '9f77196a-389e-4648-b2d9-45996d855902', 'af1a0d26-3f4b-411c-bd66-30597408982e', '2aaa271a-9e5a-4058-b764-bbb060c0d18a'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['711cd08b-396b-400d-b936-430014048ddd', 'cd8ab652-ec95-4a54-8312-29e6a8cab649', 'bfe63227-d989-48d6-829f-2b2594ac6363', '2ea0542a-a0d3-43b7-86d2-01601f3abe57'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:34 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9730397b-3efb-4391-9146-ccb0a9f43baa tempest-GroupSnapshotsTest-1138843432 None] group_snapshot a0942b85-eaaf-4bb4-8a27-a9de6604825d: deleted successfully Apr 20 17:08:34 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:34 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70deae99-670b-4a2f-a82f-a7e424da2813 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f" returned: 0 in 0.713s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:34 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f is being set with open permissions: ugo+rw Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f78b745b-1571-4f8c-8f0c-6e003e6f58df" returned: 0 in 0.623s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:34 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f Apr 20 17:08:34 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Lock "cinder-quobyte-f78b745b-1571-4f8c-8f0c-6e003e6f58df" released by "delete_volume" :: held 1.534s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Created reservations ['0b7eedc1-f0db-4299-a492-6fa8a6d542ea', 'd5ffb46b-e0b1-49c4-985c-f43ab6d07625', '82dcb4fb-bf1f-409e-aaf2-f36374db61f0', '72ddfdca-0811-43b3-8081-5a18d1519548'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:34 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:34 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:35 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f" returned: 0 in 0.480s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:35 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.info Apr 20 17:08:35 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[790b2f80-18ff-4264-9cf6-4669f2097f7a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:35 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db Apr 20 17:08:35 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:35 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.979s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:35 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Deleted volume successfully. Apr 20 17:08:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f03d6f78-3c9f-4e92-a7a7-e5e5d6bc7147 tempest-VolumesActionsTest-987572482 None] Lock "cinder-f78b745b-1571-4f8c-8f0c-6e003e6f58df-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:36 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.info" returned: 0 in 0.818s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:36 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.info is being set with open permissions: ugo+rw Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:36 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.info Apr 20 17:08:36 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:36 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" returned: 0 in 0.808s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:36 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db Apr 20 17:08:36 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:36 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" returned: 0 in 0.488s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-5faf42e7-e37f-43b5-af80-4c6d3e29b3db" released by "delete_volume" :: held 1.340s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-b16c40f5-1d80-4b29-8814-632cba22e6f4" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-b16c40f5-1d80-4b29-8814-632cba22e6f4" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ef734d-2a89-4de1-ade1-b973ae60323c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:36 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.info" returned: 0 in 0.631s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:36 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1483f352-8ffc-4d0d-905b-c72bb5cc8b32 tempest-VolumesSnapshotTestJSON-1605456745 None] Create snapshot completed successfully Apr 20 17:08:36 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 Apr 20 17:08:36 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:36 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Flow 'volume_create_manager' (14bfbe58-f3ba-48e0-8078-44712463421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f99bc6d-0259-49b7-8cad-baef7d01967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f99bc6d-0259-49b7-8cad-baef7d01967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-628162134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7842a8f2-cfd0-4386-9b8b-0d8f04134127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d213fd54bd50498a98f89fc66786756c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:37Z,use_quota=True,user_id='efdf29b9e50f47789afc80a0cda07814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36ceb49-3a16-4e9c-ac25-6f5ed98ba6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36ceb49-3a16-4e9c-ac25-6f5ed98ba6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f2b309-bdae-4e92-ab5d-5613079a4fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f2b309-bdae-4e92-ab5d-5613079a4fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7842a8f2-cfd0-4386-9b8b-0d8f04134127', 'volume_name': 'volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9f2802-99c5-4296-ad3e-53f79bf9ca19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9f2802-99c5-4296-ad3e-53f79bf9ca19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2136d0-413a-4a64-ae00-fd058da925c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Volume 7842a8f2-cfd0-4386-9b8b-0d8f04134127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127', 'volume_size': 1} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-628162134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7842a8f2-cfd0-4386-9b8b-0d8f04134127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d213fd54bd50498a98f89fc66786756c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:37Z,use_quota=True,user_id='efdf29b9e50f47789afc80a0cda07814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Creating volume 7842a8f2-cfd0-4386-9b8b-0d8f04134127 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:37 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:37 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 1073741824 Apr 20 17:08:37 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:37 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4" returned: 0 in 0.588s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:37 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4 Apr 20 17:08:37 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (7b12a0d2-dad4-46ab-a02b-a8caa43cf54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bab4330-7992-424a-8bc0-f14aa87daceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bab4330-7992-424a-8bc0-f14aa87daceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272936426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3c58c9-3380-49cc-9012-6a27a778d307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30af806587dc4012ad410983fb8d754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97734273-dc50-4c02-9420-ba572267f73f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:37Z,use_quota=True,user_id='0722c8b4fbdd4c3db7f91988ec494e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc32444-0699-4769-b74f-a718fd5f36cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc32444-0699-4769-b74f-a718fd5f36cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a77151-b8a4-442d-b2a0-fa4d158236db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a77151-b8a4-442d-b2a0-fa4d158236db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea3c58c9-3380-49cc-9012-6a27a778d307', 'volume_name': 'volume-ea3c58c9-3380-49cc-9012-6a27a778d307', 'volume_size': 1, 'snapshot_id': '97734273-dc50-4c02-9420-ba572267f73f'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c94532d-678f-4c4b-8de6-466849a547b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c94532d-678f-4c4b-8de6-466849a547b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659541a3-1560-4703-b754-bcd5219cb1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:37 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Volume ea3c58c9-3380-49cc-9012-6a27a778d307: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea3c58c9-3380-49cc-9012-6a27a778d307', 'volume_size': 1, 'snapshot_id': '97734273-dc50-4c02-9420-ba572267f73f'} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:37 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 1073741824" returned: 0 in 0.563s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:37 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 Apr 20 17:08:37 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:37 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b16c40f5-1d80-4b29-8814-632cba22e6f4" returned: 0 in 0.475s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-b16c40f5-1d80-4b29-8814-632cba22e6f4" released by "delete_volume" :: held 1.098s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['bd5643ab-4fed-41c5-9220-ea0d7e0b136f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:37 devstack cinder-volume[82240]: WARNING cinder.quota [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-752792469 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-752792469, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['e45823b0-e11c-4572-9a04-ef36eb657f8a', '11ac8ffb-8173-4486-bf4d-1adae4d38853', '9c3648ce-5181-479d-82a8-9caa20ecb63b', '02d073b8-a5de-4934-a588-642032ecc085'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:37 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['57351454-8ecf-4e49-8c87-a76e9ada2428', '824df7fc-11fb-4bf9-94c3-7bcbabedf86e', '9e822038-e6e0-4167-9c88-fa70ee2a68b5', '9ca4773d-3ef9-452e-9f4c-154eb8854614'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:38 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:38 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:38 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127" returned: 0 in 0.475s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.768s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-97734273-dc50-4c02-9420-ba572267f73f-ea3c58c9-3380-49cc-9012-6a27a778d307" by "_create_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-97734273-dc50-4c02-9420-ba572267f73f-ea3c58c9-3380-49cc-9012-6a27a778d307" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Creating volume ea3c58c9-3380-49cc-9012-6a27a778d307 from snapshot 97734273-dc50-4c02-9420-ba572267f73f {{(pid=82240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-ea3c58c9-3380-49cc-9012-6a27a778d307" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2136d0-413a-4a64-ae00-fd058da925c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a069be4-d5ca-4936-b66b-6d2fceb84e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Volume volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 (7842a8f2-cfd0-4386-9b8b-0d8f04134127): created successfully Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a069be4-d5ca-4936-b66b-6d2fceb84e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Flow 'volume_create_manager' (14bfbe58-f3ba-48e0-8078-44712463421c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-ea3c58c9-3380-49cc-9012-6a27a778d307" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] snapshot: 97734273-dc50-4c02-9420-ba572267f73f, volume: ea3c58c9-3380-49cc-9012-6a27a778d307, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-daf91333-5d56-4ab3-b699-2d2e6362b5aa tempest-VolumesTransfersV355Test-204579531 None] Created volume successfully. Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b75f11-e22d-42e5-af3a-2d3f639b1136]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:38 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f Apr 20 17:08:38 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:38 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.480s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9f85afc6-9162-4d15-a3ff-15f93fe1c599 tempest-GroupSnapshotsTest-1138843432 None] Delete group completed successfully. Apr 20 17:08:38 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f" returned: 0 in 0.537s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70deae99-670b-4a2f-a82f-a7e424da2813(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31fb90e-cdbc-4f43-80b8-1ecad41dab27]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:38 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 Apr 20 17:08:38 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-60c633c1-5b7d-451f-abd6-54df5d3b9a33 tempest-GroupSnapshotsTest-1138843432 None] Group tempest-GroupSnapshotsTest-Group-1671345323: creating Apr 20 17:08:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-60c633c1-5b7d-451f-abd6-54df5d3b9a33 tempest-GroupSnapshotsTest-1138843432 None] Group tempest-GroupSnapshotsTest-Group-1671345323: created successfully Apr 20 17:08:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-60c633c1-5b7d-451f-abd6-54df5d3b9a33 tempest-GroupSnapshotsTest-1138843432 None] Create group completed successfully. Apr 20 17:08:39 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813" returned: 0 in 0.538s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:39 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:08:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:39 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 Apr 20 17:08:39 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:39 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ca6845d8-39a5-4887-80b5-95c46b29eb7e tempest-VolumesTransfersV355Test-1581684382 None] Transfer volume completed successfully. Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Acquiring lock "cinder-7842a8f2-cfd0-4386-9b8b-0d8f04134127-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Flow 'volume_create_manager' (57a36509-7f5d-40ac-a5c3-7316c3b0bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f4139c-3951-4482-bef3-7db74ea5b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f4139c-3951-4482-bef3-7db74ea5b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375356992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e0caa18-0d3b-4ecd-8bd5-91c1f1d69cbd,host='devstack@QuobyteHD#QuobyteHD',id=4c0564ea-bf79-44b0-a341-47e3d4ff77ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b894766013a7425ead4b55c74f68e99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:41Z,use_quota=True,user_id='823dab3fc04548648007022d1de9ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13181f15-352a-4bc4-aa1e-7a21aea2f5de),volume_type_id=13181f15-352a-4bc4-aa1e-7a21aea2f5de)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2efa366-92a8-4457-a61c-0931e1b8b82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2efa366-92a8-4457-a61c-0931e1b8b82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8927d199-4b23-4a64-a9ba-5534c2e1d056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8927d199-4b23-4a64-a9ba-5534c2e1d056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0564ea-bf79-44b0-a341-47e3d4ff77ac', 'volume_name': 'volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1670848-39bd-4cba-a4cf-4a48f232a13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1670848-39bd-4cba-a4cf-4a48f232a13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadbf4bf-1b09-43cb-97c0-1a136092c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:41 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Volume 4c0564ea-bf79-44b0-a341-47e3d4ff77ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac', 'volume_size': 1} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Lock "cinder-7842a8f2-cfd0-4386-9b8b-0d8f04134127-delete_volume" acquired by "delete_volume" :: waited 0.324s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Acquiring lock "cinder-quobyte-7842a8f2-cfd0-4386-9b8b-0d8f04134127" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Lock "cinder-quobyte-7842a8f2-cfd0-4386-9b8b-0d8f04134127" acquired by "delete_volume" :: waited 0.028s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72047b4-ac05-4804-93d6-1e94b717a733]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:41 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 Apr 20 17:08:41 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:41 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307" returned: 0 in 2.242s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b13f5d7-7798-419b-8654-314279275b42]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:41 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 Apr 20 17:08:41 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:41 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:41 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127 Apr 20 17:08:41 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:42 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813" returned: 0 in 0.651s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:08:42 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Converted 1024.00 MB image at 456.50 MB/s Apr 20 17:08:42 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 is being set with open permissions: ugo+rw Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:42 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 Apr 20 17:08:42 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:42 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7842a8f2-cfd0-4386-9b8b-0d8f04134127" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Lock "cinder-quobyte-7842a8f2-cfd0-4386-9b8b-0d8f04134127" released by "delete_volume" :: held 1.009s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (e8c8453e-7663-43ad-ae0a-2eb1f2ca7e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fd28e8-62bf-4ef8-b7bb-4afc50e0055b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fd28e8-62bf-4ef8-b7bb-4afc50e0055b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1101350457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d898b81-e868-4417-9bc6-a6a40cc19f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:42Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6799e6-05ac-4f5d-a4b4-99cba8f17aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6799e6-05ac-4f5d-a4b4-99cba8f17aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f728d8-f99e-4b69-9c1d-adfdf6930752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f728d8-f99e-4b69-9c1d-adfdf6930752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d898b81-e868-4417-9bc6-a6a40cc19f58', 'volume_name': 'volume-4d898b81-e868-4417-9bc6-a6a40cc19f58', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331fe309-d0d5-455e-bde8-898ef2254b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331fe309-d0d5-455e-bde8-898ef2254b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cab8add-fe1e-48a7-a8ab-9ff60aac4f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:42 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Volume 4d898b81-e868-4417-9bc6-a6a40cc19f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d898b81-e868-4417-9bc6-a6a40cc19f58', 'volume_size': 1} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Created reservations ['c5477978-25b3-4166-b518-33b0bae65fa9', '870e3b91-1f5a-4f3e-b059-60b1af8861f5', '9526e647-a9ce-4e7d-9751-1140c6e9cda1', '86296822-3009-4bec-aa93-7e0b6cdc1daf'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:42 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:42 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:42 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307" returned: 0 in 0.464s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-ea3c58c9-3380-49cc-9012-6a27a778d307" released by "_copy_volume_from_snapshot" :: held 4.488s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-97734273-dc50-4c02-9420-ba572267f73f-ea3c58c9-3380-49cc-9012-6a27a778d307" released by "_create_volume_from_snapshot" :: held 4.529s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.538s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e0caa18-0d3b-4ecd-8bd5-91c1f1d69cbd,created_at=2026-04-20T15:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375356992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e0caa18-0d3b-4ecd-8bd5-91c1f1d69cbd,host='devstack@QuobyteHD#QuobyteHD',id=4c0564ea-bf79-44b0-a341-47e3d4ff77ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b894766013a7425ead4b55c74f68e99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:41Z,use_quota=True,user_id='823dab3fc04548648007022d1de9ad71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13181f15-352a-4bc4-aa1e-7a21aea2f5de),volume_type_id=13181f15-352a-4bc4-aa1e-7a21aea2f5de)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Creating volume 4c0564ea-bf79-44b0-a341-47e3d4ff77ac {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:42 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:42 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac 1073741824 Apr 20 17:08:42 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659541a3-1560-4703-b754-bcd5219cb1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3c58c9-3380-49cc-9012-6a27a778d307', 'volume_size': 1, 'snapshot_id': '97734273-dc50-4c02-9420-ba572267f73f'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dd8ed8-d2f2-4906-b89a-fd0b745c1cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:42 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Volume volume-ea3c58c9-3380-49cc-9012-6a27a778d307 (ea3c58c9-3380-49cc-9012-6a27a778d307): created successfully Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dd8ed8-d2f2-4906-b89a-fd0b745c1cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Flow 'volume_create_manager' (7b12a0d2-dad4-46ab-a02b-a8caa43cf54a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:42 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e7c183ce-c80f-4af9-9bbd-955aa5b1a3df tempest-VolumesSnapshotTestJSON-1605456745 None] Created volume successfully. Apr 20 17:08:43 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.420s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Deleted volume successfully. Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4978d325-08e1-43e4-9013-e4aa6185b0dd tempest-VolumesTransfersV355Test-226027585 None] Lock "cinder-7842a8f2-cfd0-4386-9b8b-0d8f04134127-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:43 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac 1073741824" returned: 0 in 0.472s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:43 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac Apr 20 17:08:43 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Flow 'volume_create_manager' (f9502bc6-89b8-48bb-bb10-176654c36f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b8d38e-a4c3-4259-8ea4-bba2ccc20a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b8d38e-a4c3-4259-8ea4-bba2ccc20a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1907828247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b96dc1d-e902-4ca1-a093-837bd864af94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d213fd54bd50498a98f89fc66786756c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:44Z,use_quota=True,user_id='efdf29b9e50f47789afc80a0cda07814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0130bb29-21c1-43f5-8d77-4ea018d87ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:43 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0130bb29-21c1-43f5-8d77-4ea018d87ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057fbddf-c4d4-4682-b59a-e32d00000cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057fbddf-c4d4-4682-b59a-e32d00000cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b96dc1d-e902-4ca1-a093-837bd864af94', 'volume_name': 'volume-5b96dc1d-e902-4ca1-a093-837bd864af94', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aea8e7d-4637-4f1d-a246-1658916c2732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aea8e7d-4637-4f1d-a246-1658916c2732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053f239f-c394-43ca-a191-6a4cb3071765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:43 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Volume 5b96dc1d-e902-4ca1-a093-837bd864af94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b96dc1d-e902-4ca1-a093-837bd864af94', 'volume_size': 1} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1101350457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d898b81-e868-4417-9bc6-a6a40cc19f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:42Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Creating volume 4d898b81-e868-4417-9bc6-a6a40cc19f58 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:43 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadbf4bf-1b09-43cb-97c0-1a136092c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fc79de-0c6f-4144-9c98-1fab702acb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:43 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 1073741824 Apr 20 17:08:43 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:43 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Volume volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac (4c0564ea-bf79-44b0-a341-47e3d4ff77ac): created successfully Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fc79de-0c6f-4144-9c98-1fab702acb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Flow 'volume_create_manager' (57a36509-7f5d-40ac-a5c3-7316c3b0bf00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8023762f-0216-43a8-af03-4980247722e3 tempest-GroupSnapshotsTest-1138843432 None] Created volume successfully. Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-ea3c58c9-3380-49cc-9012-6a27a778d307-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-ea3c58c9-3380-49cc-9012-6a27a778d307-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-ea3c58c9-3380-49cc-9012-6a27a778d307" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-ea3c58c9-3380-49cc-9012-6a27a778d307" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c7a073-2f46-4e44-a844-db4908395352]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:43 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 Apr 20 17:08:43 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:44 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 1073741824" returned: 0 in 0.502s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:44 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 Apr 20 17:08:44 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:44 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307" returned: 0 in 0.525s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:44 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307 Apr 20 17:08:44 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:44 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] GroupSnapshot 050025d9-23b6-46ac-87e9-2faecf5347c6: creating. Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Group snapshot 050025d9-23b6-46ac-87e9-2faecf5347c6: creating. {{(pid=82240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:44 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58" returned: 0 in 0.451s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1907828247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b96dc1d-e902-4ca1-a093-837bd864af94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d213fd54bd50498a98f89fc66786756c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:44Z,use_quota=True,user_id='efdf29b9e50f47789afc80a0cda07814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Creating volume 5b96dc1d-e902-4ca1-a093-837bd864af94 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:44 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cab8add-fe1e-48a7-a8ab-9ff60aac4f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d898b81-e868-4417-9bc6-a6a40cc19f58', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3cbf63-6781-43ea-b8c8-12f3583dedca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:44 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 1073741824 Apr 20 17:08:44 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:44 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Volume volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 (4d898b81-e868-4417-9bc6-a6a40cc19f58): created successfully Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3cbf63-6781-43ea-b8c8-12f3583dedca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (e8c8453e-7663-43ad-ae0a-2eb1f2ca7e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:44 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a2373e6f-7add-4c8e-bee2-ee5f55dc5987 tempest-VolumesActionsTest-987572482 None] Created volume successfully. Apr 20 17:08:44 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ea3c58c9-3380-49cc-9012-6a27a778d307" returned: 0 in 0.429s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-ea3c58c9-3380-49cc-9012-6a27a778d307" released by "delete_volume" :: held 0.975s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Created reservations ['68efb3fd-2d3c-4f1b-b3fe-b6dbb3ea628f', 'b10185d1-ca85-4886-b969-731532c25c48', '5f9001a4-de93-4092-9530-2f8420a6f0dc', '35f45287-21c4-40ac-b189-ce3ba9714288'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:44 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:44 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-97734273-dc50-4c02-9420-ba572267f73f-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-97734273-dc50-4c02-9420-ba572267f73f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-70deae99-670b-4a2f-a82f-a7e424da2813" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-70deae99-670b-4a2f-a82f-a7e424da2813" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-97734273-dc50-4c02-9420-ba572267f73f" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-97734273-dc50-4c02-9420-ba572267f73f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Deleting offline snapshot 97734273-dc50-4c02-9420-ba572267f73f of volume 70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] snapshot_file for this snap is: volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[376eed8d-9e1a-4401-ad3d-1e84ab8aed0d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:45 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f Apr 20 17:08:45 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:45 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 1073741824" returned: 0 in 0.533s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:45 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 Apr 20 17:08:45 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:45 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.466s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:45 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Deleted volume successfully. Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-654d1686-1977-4e0e-955d-513c06badeb7 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-ea3c58c9-3380-49cc-9012-6a27a778d307-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:45 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f" returned: 0 in 0.524s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70deae99-670b-4a2f-a82f-a7e424da2813(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbe8136-4af5-46ca-92a6-84f2669fb37c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:45 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 Apr 20 17:08:45 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:45 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94" returned: 0 in 0.444s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.176s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053f239f-c394-43ca-a191-6a4cb3071765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b96dc1d-e902-4ca1-a093-837bd864af94', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bd7943-e6d9-496b-989a-50696afe92cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-4d898b81-e868-4417-9bc6-a6a40cc19f58-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:45 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Volume volume-5b96dc1d-e902-4ca1-a093-837bd864af94 (5b96dc1d-e902-4ca1-a093-837bd864af94): created successfully Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bd7943-e6d9-496b-989a-50696afe92cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Flow 'volume_create_manager' (f9502bc6-89b8-48bb-bb10-176654c36f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Creating offline snapshot 63c9c02a-ce4a-47ce-800a-4b183b27bd66 of volume 4c0564ea-bf79-44b0-a341-47e3d4ff77ac {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80e03e6-fc7b-40cd-9142-43af3469dec3]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:45 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-31e10372-d9b1-4d8c-8da7-78b656e26c05 tempest-VolumesTransfersV355Test-204579531 None] Created volume successfully. Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Lock "cinder-4d898b81-e868-4417-9bc6-a6a40cc19f58-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-quobyte-4d898b81-e868-4417-9bc6-a6a40cc19f58" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Lock "cinder-quobyte-4d898b81-e868-4417-9bc6-a6a40cc19f58" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968aad6-823b-46ec-855a-a0ed24bf0baa]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:45 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac Apr 20 17:08:45 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:45 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 Apr 20 17:08:45 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:46 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813" returned: 0 in 0.548s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:46 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f Apr 20 17:08:46 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:46 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:46 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 1G Apr 20 17:08:46 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:46 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58" returned: 0 in 0.485s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:46 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58 Apr 20 17:08:46 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:46 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f" returned: 0 in 0.468s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:46 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f Apr 20 17:08:46 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:46 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4d898b81-e868-4417-9bc6-a6a40cc19f58" returned: 0 in 0.442s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Lock "cinder-quobyte-4d898b81-e868-4417-9bc6-a6a40cc19f58" released by "delete_volume" :: held 0.949s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:46 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 1G" returned: 0 in 0.554s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:46 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 Apr 20 17:08:46 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Created reservations ['4b128cac-c4a7-4e31-ae18-6ecc75b801fb', 'a5cd936e-f01f-4616-a288-c0a6c9ee620e', 'c177d326-400e-4491-a1a2-14c32d6ee272', '02db9b1d-159d-4db5-9d29-5f98958a4264'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:46 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:46 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:47 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813.97734273-dc50-4c02-9420-ba572267f73f" returned: 0 in 0.462s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-97734273-dc50-4c02-9420-ba572267f73f" released by "_delete_snapshot" :: held 2.070s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-70deae99-670b-4a2f-a82f-a7e424da2813" released by "delete_snapshot" :: held 2.082s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Created reservations ['e828f98f-35e1-49b4-bd78-11822df56f45', 'ef936be0-fa74-4fb9-b77e-bad77aba61e8', '0358958b-adf4-4854-a578-c02b3a3fd9d3', '349ba28b-9597-4473-8a54-93e430977a61'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:47 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Delete snapshot completed successfully. Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e738651-0a1b-4d82-9666-1a0ea0221607 tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-97734273-dc50-4c02-9420-ba572267f73f-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Acquiring lock "cinder-5b96dc1d-e902-4ca1-a093-837bd864af94-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Lock "cinder-5b96dc1d-e902-4ca1-a093-837bd864af94-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Acquiring lock "cinder-quobyte-5b96dc1d-e902-4ca1-a093-837bd864af94" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:47 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66" returned: 0 in 0.497s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:47 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Lock "cinder-quobyte-5b96dc1d-e902-4ca1-a093-837bd864af94" acquired by "delete_volume" :: waited 0.021s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:47 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 Apr 20 17:08:47 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeb88f4-8f0c-4177-924b-3e92eca89d0f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:47 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 Apr 20 17:08:47 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:47 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.518s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:47 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Deleted volume successfully. Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12b6b660-0493-494a-bb67-d4d5e0f3d9b4 tempest-VolumesActionsTest-108170520 None] Lock "cinder-4d898b81-e868-4417-9bc6-a6a40cc19f58-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:47 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66" returned: 0 in 0.436s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:47 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.info Apr 20 17:08:47 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:47 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94" returned: 0 in 0.472s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:47 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94 Apr 20 17:08:47 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (bac40e66-e985-444a-b470-79237085f075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dae6de1-a248-41e9-ad1a-97d8a5fc3026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dae6de1-a248-41e9-ad1a-97d8a5fc3026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-372718035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3e1487-4e61-47f7-8159-0535a98d5d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:48Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3767dc-0266-45a9-8280-39e8c408f4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3767dc-0266-45a9-8280-39e8c408f4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac8e3e3-2b24-4e2c-81f3-3064cde09028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac8e3e3-2b24-4e2c-81f3-3064cde09028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3e1487-4e61-47f7-8159-0535a98d5d06', 'volume_name': 'volume-8a3e1487-4e61-47f7-8159-0535a98d5d06', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c4b996-7f21-4dbc-8bf1-c0601d106991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c4b996-7f21-4dbc-8bf1-c0601d106991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81570285-082f-43b1-a308-df3664d826b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:48 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Volume 8a3e1487-4e61-47f7-8159-0535a98d5d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3e1487-4e61-47f7-8159-0535a98d5d06', 'volume_size': 1} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-70deae99-670b-4a2f-a82f-a7e424da2813-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-70deae99-670b-4a2f-a82f-a7e424da2813-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:48 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5b96dc1d-e902-4ca1-a093-837bd864af94" returned: 0 in 0.458s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Lock "cinder-quobyte-5b96dc1d-e902-4ca1-a093-837bd864af94" released by "delete_volume" :: held 0.959s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:48 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-70deae99-670b-4a2f-a82f-a7e424da2813" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.info" returned: 0 in 0.541s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:48 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.info is being set with open permissions: ugo+rw: NotImplementedError Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-70deae99-670b-4a2f-a82f-a7e424da2813" acquired by "delete_volume" :: waited 0.027s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:48 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.info Apr 20 17:08:48 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8231089f-19bc-4bb5-b068-1b9c8d417c2b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Created reservations ['acbc5d13-3c74-49ef-b012-98779009759f', 'ba47888f-8eaf-4a7a-b5ac-a7b7171dc030', 'ec2ce210-037b-4fbb-b4d4-8e96a1c6a392', '441348ec-cfde-4ab3-bf71-1bb621269d02'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:48 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 Apr 20 17:08:48 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:48 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:48 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:48 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.info" returned: 0 in 0.441s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.041s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-372718035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3e1487-4e61-47f7-8159-0535a98d5d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:48Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Creating volume 8a3e1487-4e61-47f7-8159-0535a98d5d06 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:48 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:48 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 1073741824 Apr 20 17:08:48 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:48 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:48 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c3f4dad3-f95b-4d9a-a7d7-3aefdf76267b tempest-GroupSnapshotsTest-1138843432 None] group_snapshot 050025d9-23b6-46ac-87e9-2faecf5347c6: created successfully Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.413s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:48 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Deleted volume successfully. Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecd1c854-a1a6-4ba4-adc0-033b4713b3a7 tempest-VolumesTransfersV355Test-226027585 None] Lock "cinder-5b96dc1d-e902-4ca1-a093-837bd864af94-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:48 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813" returned: 0 in 0.497s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:48 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813 Apr 20 17:08:48 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:49 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 1073741824" returned: 0 in 0.501s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:49 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-70deae99-670b-4a2f-a82f-a7e424da2813" returned: 0 in 0.440s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-70deae99-670b-4a2f-a82f-a7e424da2813" released by "delete_volume" :: held 0.991s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:49 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 Apr 20 17:08:49 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Created reservations ['67082908-fef7-430d-a356-c401c2be071c', '083d9f93-4a0c-4192-8ed5-1310c5f46605', '8a58b279-8841-48f1-9679-665581928a59', '7f89b964-2897-417b-bcbf-b74ad0894da3'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:49 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:49 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:49 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81570285-082f-43b1-a308-df3664d826b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3e1487-4e61-47f7-8159-0535a98d5d06', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9040e765-fbc8-43a0-8613-b8fcc99eb712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:49 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Volume volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 (8a3e1487-4e61-47f7-8159-0535a98d5d06): created successfully Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9040e765-fbc8-43a0-8613-b8fcc99eb712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (bac40e66-e985-444a-b470-79237085f075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9dd43034-11f9-4905-b18b-d0dfe83a2ffe tempest-VolumesActionsTest-987572482 None] Created volume successfully. Apr 20 17:08:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] group_snapshot 050025d9-23b6-46ac-87e9-2faecf5347c6: deleting Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] group_snapshot 050025d9-23b6-46ac-87e9-2faecf5347c6: deleting {{(pid=82240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-63c9c02a-ce4a-47ce-800a-4b183b27bd66" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:49 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-63c9c02a-ce4a-47ce-800a-4b183b27bd66" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Deleting offline snapshot 63c9c02a-ce4a-47ce-800a-4b183b27bd66 of volume 4c0564ea-bf79-44b0-a341-47e3d4ff77ac {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] snapshot_file for this snap is: volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.520s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a0c1d-6b9b-4eb2-ab01-1efd3f075dd0]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Deleted volume successfully. Apr 20 17:08:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1dc2c9b4-b41f-4eea-b8fb-02e2515b4b4e tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-70deae99-670b-4a2f-a82f-a7e424da2813-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:49 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 Apr 20 17:08:49 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-8a3e1487-4e61-47f7-8159-0535a98d5d06-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Lock "cinder-8a3e1487-4e61-47f7-8159-0535a98d5d06-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-quobyte-8a3e1487-4e61-47f7-8159-0535a98d5d06" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-d6018ce8-a1a3-4959-b15e-c693f85e6c16-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:50 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Lock "cinder-quobyte-8a3e1487-4e61-47f7-8159-0535a98d5d06" acquired by "delete_volume" :: waited 0.031s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66" returned: 0 in 0.596s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-d6018ce8-a1a3-4959-b15e-c693f85e6c16-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[87132001-174d-4a70-ba51-4b2b8dc0e761]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[416fbf20-6c8a-4e8f-922f-18b06bfabbfd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "cinder-quobyte-d6018ce8-a1a3-4959-b15e-c693f85e6c16" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-d6018ce8-a1a3-4959-b15e-c693f85e6c16" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe85967-7bcb-4ad7-a241-7ac55488a5c6]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:50 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 Apr 20 17:08:50 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:50 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac Apr 20 17:08:50 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:50 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 Apr 20 17:08:50 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:51 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06" returned: 0 in 0.594s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:51 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06 Apr 20 17:08:51 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:51 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" returned: 0 in 0.628s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:51 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 Apr 20 17:08:51 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:51 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16" returned: 0 in 0.581s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:51 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16 Apr 20 17:08:51 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:51 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a3e1487-4e61-47f7-8159-0535a98d5d06" returned: 0 in 0.515s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Lock "cinder-quobyte-8a3e1487-4e61-47f7-8159-0535a98d5d06" released by "delete_volume" :: held 1.156s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Created reservations ['2f35239f-f700-477b-b550-7f2508c25809', '3805c3ae-b202-4b1f-8f52-c27ab9879e53', '1a510d51-d079-4b52-a32f-c74a7b33d551', '522078e6-96cd-47bf-987f-851c65bd5f71'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:51 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d6018ce8-a1a3-4959-b15e-c693f85e6c16" returned: 0 in 0.515s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-quobyte-d6018ce8-a1a3-4959-b15e-c693f85e6c16" released by "delete_volume" :: held 1.129s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:51 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Created reservations ['eb6c4880-2ede-44ed-8d4c-40b7fb9aa30d', '6fc03a93-4e7f-4d48-8234-7f32063af868', '1d0fa755-b764-4c67-86ee-0a320728a323', 'f0c4cb9f-81ee-4538-b14e-a0ee2cfced9c'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66" returned: 0 in 0.618s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:51 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:51 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:51 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66 Apr 20 17:08:51 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:51 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:51 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:52 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.513s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:52 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Deleted volume successfully. Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8cfb5f33-8ed6-4b80-8409-ed54d2b4125c tempest-VolumesActionsTest-108170520 None] Lock "cinder-8a3e1487-4e61-47f7-8159-0535a98d5d06-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:52 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:52 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Deleted volume successfully. Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-64de2a8f-b958-4fca-90f5-c86c222f024b tempest-VolumesSnapshotTestJSON-1605456745 None] Lock "cinder-d6018ce8-a1a3-4959-b15e-c693f85e6c16-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:52 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac.63c9c02a-ce4a-47ce-800a-4b183b27bd66" returned: 0 in 0.557s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-63c9c02a-ce4a-47ce-800a-4b183b27bd66" released by "_delete_snapshot" :: held 2.468s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" released by "delete_snapshot" :: held 2.488s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:52 devstack cinder-volume[82240]: WARNING cinder.quota [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1513655009 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1513655009, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:08:52 devstack cinder-volume[82240]: WARNING cinder.quota [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1513655009 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1513655009, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['9def15d2-5116-48ec-a4e2-c3885262bddf', 'ed625a74-699b-445a-9b41-6e4e76c7a9a0', 'b2c7ac2a-0f2d-4ac7-8de4-c04beaafac97', '1d31b0e4-1646-412c-9c9e-31c57b5ab3f7'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:52 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-935221ba-5878-4df8-b2ed-0b3607f5940e tempest-GroupSnapshotsTest-1138843432 None] group_snapshot 050025d9-23b6-46ac-87e9-2faecf5347c6: deleted successfully Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Flow 'volume_create_manager' (91673ea4-1ba9-42bb-bd64-8dd65a96cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6724dd2f-1a3e-4ce1-9b69-51efc41e57d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6724dd2f-1a3e-4ce1-9b69-51efc41e57d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1976586082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bacb502-f4ad-4d18-9e65-0219151a02a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7421dd0fff384071aca989bbb207535e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:53Z,use_quota=True,user_id='1dbc27ceca244320810e05f19fd4cf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9647da0e-14be-42e9-8d30-ed700c1d590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9647da0e-14be-42e9-8d30-ed700c1d590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588350f8-1e6d-41d2-8d15-092ad0c01552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588350f8-1e6d-41d2-8d15-092ad0c01552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bacb502-f4ad-4d18-9e65-0219151a02a4', 'volume_name': 'volume-5bacb502-f4ad-4d18-9e65-0219151a02a4', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5687ed2-8c70-46cc-9d56-3a0c1c4da3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5687ed2-8c70-46cc-9d56-3a0c1c4da3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf0fe55-cbe4-428b-be17-3cdd9448e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:53 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Volume 5bacb502-f4ad-4d18-9e65-0219151a02a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bacb502-f4ad-4d18-9e65-0219151a02a4', 'volume_size': 1} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1976586082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bacb502-f4ad-4d18-9e65-0219151a02a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7421dd0fff384071aca989bbb207535e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:53Z,use_quota=True,user_id='1dbc27ceca244320810e05f19fd4cf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Creating volume 5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:53 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:53 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 1073741824 Apr 20 17:08:53 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (12bcce38-decf-4cbe-bf1a-27e535303317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fde171c-149d-4bb7-94fa-1343aafe9d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fde171c-149d-4bb7-94fa-1343aafe9d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566211762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48033bd0-a6ec-4b58-96fa-139b1e8e6a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:53Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ab478d-f9e6-4a04-ab85-1d966dfd29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ab478d-f9e6-4a04-ab85-1d966dfd29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7621cfc8-3e01-40ce-95f0-be321cd56f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7621cfc8-3e01-40ce-95f0-be321cd56f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48033bd0-a6ec-4b58-96fa-139b1e8e6a29', 'volume_name': 'volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af29a592-61ce-4bc3-b880-e6a1a0a4069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af29a592-61ce-4bc3-b880-e6a1a0a4069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9e3767-7cc9-4cb8-97f1-517693cf9a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:53 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Volume 48033bd0-a6ec-4b58-96fa-139b1e8e6a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29', 'volume_size': 1} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "cinder-quobyte-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e79f171-19f9-4608-99dc-054b668900f3]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:53 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac Apr 20 17:08:53 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:53 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 1073741824" returned: 0 in 0.575s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:53 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 Apr 20 17:08:53 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:53 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" returned: 0 in 0.532s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:53 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac Apr 20 17:08:53 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:54 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4" returned: 0 in 0.463s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.967s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566211762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48033bd0-a6ec-4b58-96fa-139b1e8e6a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:53Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Creating volume 48033bd0-a6ec-4b58-96fa-139b1e8e6a29 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:54 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf0fe55-cbe4-428b-be17-3cdd9448e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bacb502-f4ad-4d18-9e65-0219151a02a4', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b714d5-b48d-4178-977a-e507b0f356ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:54 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 1073741824 Apr 20 17:08:54 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:54 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Volume volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 (5bacb502-f4ad-4d18-9e65-0219151a02a4): created successfully Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b714d5-b48d-4178-977a-e507b0f356ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Flow 'volume_create_manager' (91673ea4-1ba9-42bb-bd64-8dd65a96cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:54 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8f4abbaf-bcb6-47ec-8695-614664dfaecf tempest-VolumesSnapshotListTestJSON-2095641407 None] Created volume successfully. Apr 20 17:08:54 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" returned: 0 in 0.486s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Lock "cinder-quobyte-4c0564ea-bf79-44b0-a341-47e3d4ff77ac" released by "delete_volume" :: held 1.052s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['1bf2da66-f9b3-46a1-913c-62e88f112264'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:54 devstack cinder-volume[82240]: WARNING cinder.quota [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1513655009 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1513655009, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Created reservations ['482ab00a-5362-4f87-8d5b-ab514e006d6f', '51e49fe4-3999-432d-9dac-a6518154bf47', 'bd430fcc-bfb3-4eb5-9369-c1e3e6b8bc95', '81336aa5-47a2-47ea-8c26-ae569c840144'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:54 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:54 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:54 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 1073741824" returned: 0 in 0.550s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:54 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 Apr 20 17:08:54 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:54 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.464s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:54 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:54 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-980c7846-1c92-4b5a-afa2-3dc301eebcfb tempest-GroupSnapshotsTest-1138843432 None] Delete group completed successfully. Apr 20 17:08:55 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9e3767-7cc9-4cb8-97f1-517693cf9a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db75245-13b2-4f94-9ef1-4f3966a6b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:55 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Volume volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 (48033bd0-a6ec-4b58-96fa-139b1e8e6a29): created successfully Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db75245-13b2-4f94-9ef1-4f3966a6b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (12bcce38-decf-4cbe-bf1a-27e535303317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:55 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1bda75df-21b2-4a9e-9f8b-9117c291114d tempest-VolumesActionsTest-987572482 None] Created volume successfully. Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Creating offline snapshot b3765783-c011-4b83-ab3f-6829ce2c9702 of volume 5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b37769b-92ec-4d48-92b4-e1beefc03aab]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:55 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 Apr 20 17:08:55 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:55 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4" returned: 0 in 0.568s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:55 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 1G Apr 20 17:08:55 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-48033bd0-a6ec-4b58-96fa-139b1e8e6a29-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Lock "cinder-48033bd0-a6ec-4b58-96fa-139b1e8e6a29-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-quobyte-48033bd0-a6ec-4b58-96fa-139b1e8e6a29" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Lock "cinder-quobyte-48033bd0-a6ec-4b58-96fa-139b1e8e6a29" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b69950e-2b56-42fc-87d9-6bbaa0dc87f1]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:56 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 1G" returned: 0 in 0.630s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:56 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 Apr 20 17:08:56 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:56 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 Apr 20 17:08:56 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:56 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702" returned: 0 in 0.519s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:56 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 is being set with open permissions: ugo+rw Apr 20 17:08:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:57 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 Apr 20 17:08:57 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:57 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29" returned: 0 in 0.632s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:57 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29 Apr 20 17:08:57 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (d4251bc7-7af4-4368-b40c-065edd703b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1852e186-afbf-4aea-9521-304eaf3a8d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1852e186-afbf-4aea-9521-304eaf3a8d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037492537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538d92b5-9c60-47e8-8506-94a955e64b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:57Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a39359d-80d8-43ad-84a6-e3febdd2c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a39359d-80d8-43ad-84a6-e3febdd2c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1c8512-04aa-46a6-b784-3f6fabd7082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1c8512-04aa-46a6-b784-3f6fabd7082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538d92b5-9c60-47e8-8506-94a955e64b0d', 'volume_name': 'volume-538d92b5-9c60-47e8-8506-94a955e64b0d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24acbf06-02f1-4afa-bbf6-720ffe327865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24acbf06-02f1-4afa-bbf6-720ffe327865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0772b658-1487-4330-bd9e-3181c7e2f637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:57 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume 538d92b5-9c60-47e8-8506-94a955e64b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538d92b5-9c60-47e8-8506-94a955e64b0d', 'volume_size': 1} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:57 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-48033bd0-a6ec-4b58-96fa-139b1e8e6a29" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Lock "cinder-quobyte-48033bd0-a6ec-4b58-96fa-139b1e8e6a29" released by "delete_volume" :: held 1.192s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:57 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702" returned: 0 in 0.592s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:57 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.info Apr 20 17:08:57 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Created reservations ['2c0fdf8a-c189-4b66-997e-bc2413e066c2', 'bef88654-9e18-4297-962f-69522ee10deb', '140c8370-c3f6-45ce-9909-79098bc0977e', '5d0186ca-2ed7-4acc-a3bc-3eae4b0728ca'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:57 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:08:57 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:58 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.info" returned: 0 in 0.492s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:58 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.info is being set with open permissions: ugo+rw Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:58 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.info Apr 20 17:08:58 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:58 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.455s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:08:58 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Deleted volume successfully. Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b717ef06-7041-4ae7-8fab-248a1af70de9 tempest-VolumesActionsTest-108170520 None] Lock "cinder-48033bd0-a6ec-4b58-96fa-139b1e8e6a29-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:08:58 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.info" returned: 0 in 0.494s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.360s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.349s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037492537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538d92b5-9c60-47e8-8506-94a955e64b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:57Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Creating volume 538d92b5-9c60-47e8-8506-94a955e64b0d {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:58 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:58 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d 1073741824 Apr 20 17:08:58 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:58 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-41ed6933-0390-4851-abe6-20b9229e0d79 tempest-VolumesSnapshotListTestJSON-2095641407 None] Create snapshot completed successfully Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (c84dc20a-d51c-4c2b-bcbc-ba1a2712648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a4d1bf-6872-4c6a-9dd1-32a899f3e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a4d1bf-6872-4c6a-9dd1-32a899f3e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-296465926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f8c72d-ddd0-4a13-b4b5-60152f4b3533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:59Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16651116-232b-4fbd-8d63-031a3cd8f52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16651116-232b-4fbd-8d63-031a3cd8f52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087c9009-eca9-4ac1-b194-e29b85b010e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087c9009-eca9-4ac1-b194-e29b85b010e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f8c72d-ddd0-4a13-b4b5-60152f4b3533', 'volume_name': 'volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fdbce5-883c-48b8-a700-59bc22b4e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fdbce5-883c-48b8-a700-59bc22b4e39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4a41b3-51dd-41b7-a7c2-83a91f01e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:58 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Volume 61f8c72d-ddd0-4a13-b4b5-60152f4b3533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533', 'volume_size': 1} Apr 20 17:08:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:59 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d 1073741824" returned: 0 in 0.548s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:59 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d Apr 20 17:08:59 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:59 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d" returned: 0 in 0.479s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.808s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-296465926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f8c72d-ddd0-4a13-b4b5-60152f4b3533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:08:59Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Creating volume 61f8c72d-ddd0-4a13-b4b5-60152f4b3533 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:08:59 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0772b658-1487-4330-bd9e-3181c7e2f637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538d92b5-9c60-47e8-8506-94a955e64b0d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:59 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 1073741824 Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae74eb4-b6db-4168-9af1-535c6b8e174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:08:59 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:08:59 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume volume-538d92b5-9c60-47e8-8506-94a955e64b0d (538d92b5-9c60-47e8-8506-94a955e64b0d): created successfully Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae74eb4-b6db-4168-9af1-535c6b8e174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:08:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (d4251bc7-7af4-4368-b40c-065edd703b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:08:59 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-dffee37d-1ada-4b8b-bbe1-0f8b5b262293 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created volume successfully. Apr 20 17:09:00 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 1073741824" returned: 0 in 0.570s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:00 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 Apr 20 17:09:00 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:00 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533" returned: 0 in 0.485s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.258s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4a41b3-51dd-41b7-a7c2-83a91f01e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ca261d-fdab-4640-b0ec-03cf9a2b2282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:00 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Volume volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 (61f8c72d-ddd0-4a13-b4b5-60152f4b3533): created successfully Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ca261d-fdab-4640-b0ec-03cf9a2b2282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (c84dc20a-d51c-4c2b-bcbc-ba1a2712648e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Creating offline snapshot 760d7b9a-6cd2-4046-8b03-a11e57bfea43 of volume 5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:09:00 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e6c02e8e-c4c1-4258-9109-b3fbc6cb465f tempest-VolumesActionsTest-987572482 None] Created volume successfully. Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae793dd4-e6cb-4e83-9f8a-d87c49cef86f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:00 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 Apr 20 17:09:00 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-61f8c72d-ddd0-4a13-b4b5-60152f4b3533-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Lock "cinder-61f8c72d-ddd0-4a13-b4b5-60152f4b3533-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Acquiring lock "cinder-quobyte-61f8c72d-ddd0-4a13-b4b5-60152f4b3533" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Lock "cinder-quobyte-61f8c72d-ddd0-4a13-b4b5-60152f4b3533" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b84b3fc-f8b5-4e82-9c35-dc1d0c1cb1f6]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:01 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 Apr 20 17:09:01 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:01 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702" returned: 0 in 0.536s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bacb502-f4ad-4d18-9e65-0219151a02a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:01 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 1G Apr 20 17:09:01 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:01 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533" returned: 0 in 0.517s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:01 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533 Apr 20 17:09:01 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:01 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 1G" returned: 0 in 0.533s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:01 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 Apr 20 17:09:01 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:02 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-61f8c72d-ddd0-4a13-b4b5-60152f4b3533" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Lock "cinder-quobyte-61f8c72d-ddd0-4a13-b4b5-60152f4b3533" released by "delete_volume" :: held 1.001s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Created reservations ['73db1a73-ce68-4870-9ec2-7bd0f4889c51', '4a8d1231-1658-4bfd-b967-b4663d17a3ab', '3ff6d250-852a-4280-8be6-a47a832e9d2f', '3f927c3a-3734-442e-94a3-12965d4330e5'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:02 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:02 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:02 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-52055381-c5fe-422b-8ed5-23abbd70921c tempest-GroupsTest-1346586840 None] Group tempest-Group1-663496187: creating Apr 20 17:09:02 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-52055381-c5fe-422b-8ed5-23abbd70921c tempest-GroupsTest-1346586840 None] Group tempest-Group1-663496187: created successfully Apr 20 17:09:02 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-52055381-c5fe-422b-8ed5-23abbd70921c tempest-GroupsTest-1346586840 None] Create group completed successfully. Apr 20 17:09:02 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43" returned: 0 in 0.475s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:02 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 is being set with open permissions: ugo+rw Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:02 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 Apr 20 17:09:02 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:02 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.403s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:02 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Deleted volume successfully. Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b974d4bf-f9a1-41bd-8269-76a5baa12498 tempest-VolumesActionsTest-108170520 None] Lock "cinder-61f8c72d-ddd0-4a13-b4b5-60152f4b3533-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:02 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43" returned: 0 in 0.414s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.321s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Creating offline snapshot 951652bf-0276-4e85-ab28-77d44aa72358 of volume 538d92b5-9c60-47e8-8506-94a955e64b0d {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:09:02 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-50ef6358-b940-4fa1-9ad5-19e9de2f955f tempest-VolumesSnapshotListTestJSON-2095641407 None] Create snapshot completed successfully Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3239bb-02d7-4b25-b6de-946fefa07e4d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:02 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d Apr 20 17:09:02 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:03 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d" returned: 0 in 0.571s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:03 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d81b66fb-1db1-4f14-996c-ba7b0f88e6b9 tempest-GroupsTest-1346586840 None] Group tempest-Group2-1058304269: creating Apr 20 17:09:03 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 1G Apr 20 17:09:03 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:03 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d81b66fb-1db1-4f14-996c-ba7b0f88e6b9 tempest-GroupsTest-1346586840 None] Group tempest-Group2-1058304269: created successfully Apr 20 17:09:03 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d81b66fb-1db1-4f14-996c-ba7b0f88e6b9 tempest-GroupsTest-1346586840 None] Create group completed successfully. Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (34d31189-9ed9-47e5-8d15-eb9862447630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bf7330-b8b1-4b00-b41e-5434bd28cc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bf7330-b8b1-4b00-b41e-5434bd28cc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1985963240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab9f168-42c6-494c-a014-0e2da790524d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:03Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf90c4fa-a990-4fcd-b530-caaf31afdffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf90c4fa-a990-4fcd-b530-caaf31afdffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5e066f-7113-4c36-9ed7-bb1e555c6757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5e066f-7113-4c36-9ed7-bb1e555c6757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab9f168-42c6-494c-a014-0e2da790524d', 'volume_name': 'volume-fab9f168-42c6-494c-a014-0e2da790524d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dc3127-655b-498f-8651-3acade1257bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dc3127-655b-498f-8651-3acade1257bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631e5c68-0979-4116-81a5-6a3fb46f40bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:03 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Volume fab9f168-42c6-494c-a014-0e2da790524d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab9f168-42c6-494c-a014-0e2da790524d', 'volume_size': 1} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:03 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 1G" returned: 0 in 0.493s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538d92b5-9c60-47e8-8506-94a955e64b0d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:03 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538d92b5-9c60-47e8-8506-94a955e64b0d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 Apr 20 17:09:03 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:04 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538d92b5-9c60-47e8-8506-94a955e64b0d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358" returned: 0 in 0.424s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:04 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 is being set with open permissions: ugo+rw Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:04 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 Apr 20 17:09:04 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Flow 'volume_create_manager' (b21c5f0a-f744-4326-831d-2319d15ce78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:04 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed93393-4ed1-4a9d-a1ce-23b9aaac2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358" returned: 0 in 0.453s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed93393-4ed1-4a9d-a1ce-23b9aaac2eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-538180798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2575c03-b37b-4cf7-ac2e-0dfdc22964a3,host='devstack@QuobyteHD#QuobyteHD',id=259d7cf6-2c26-4cd6-b63f-9821a8f08760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c812b015a83480791018863335e1e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:05Z,use_quota=True,user_id='3888f2bdb6a7489eabb49e6c131544b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f93f050f-58fb-4001-9ca3-50cd3f8fa00a),volume_type_id=f93f050f-58fb-4001-9ca3-50cd3f8fa00a)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0819f01d-0b1b-4424-ab1a-243de95cea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0819f01d-0b1b-4424-ab1a-243de95cea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e179910-415f-4d9c-a735-381ad87c7a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e179910-415f-4d9c-a735-381ad87c7a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259d7cf6-2c26-4cd6-b63f-9821a8f08760', 'volume_name': 'volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d150deb1-a160-462b-b03e-006be50e8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d150deb1-a160-462b-b03e-006be50e8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f1fa81-f97a-4a28-bf2d-71834d725cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:04 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Volume 259d7cf6-2c26-4cd6-b63f-9821a8f08760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760', 'volume_size': 1} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:04 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.info Apr 20 17:09:04 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:05 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.info" returned: 0 in 0.414s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:05 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.info is being set with open permissions: ugo+rw Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:05 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.info Apr 20 17:09:05 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:05 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.info" returned: 0 in 0.419s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.865s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.122s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1985963240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab9f168-42c6-494c-a014-0e2da790524d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2603ec35fa74ea983a4db80e47b5447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:03Z,use_quota=True,user_id='0b192311f8c546659d755b5bce3f024d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Creating volume fab9f168-42c6-494c-a014-0e2da790524d {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:05 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:05 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d 1073741824 Apr 20 17:09:05 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:05 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b8b4fccf-0879-4f40-8180-d2806b8f928a tempest-CreateVolumesFromSnapshotTest-854420740 None] Create snapshot completed successfully Apr 20 17:09:06 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d 1073741824" returned: 0 in 0.495s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:06 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d Apr 20 17:09:06 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:06 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d" returned: 0 in 0.405s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.903s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631e5c68-0979-4116-81a5-6a3fb46f40bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab9f168-42c6-494c-a014-0e2da790524d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5f32bf-3760-498a-9e71-76aaa4c77cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Volume volume-fab9f168-42c6-494c-a014-0e2da790524d (fab9f168-42c6-494c-a014-0e2da790524d): created successfully Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5f32bf-3760-498a-9e71-76aaa4c77cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Flow 'volume_create_manager' (34d31189-9ed9-47e5-8d15-eb9862447630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Creating offline snapshot 2d796f1b-bcda-44b0-b4d8-80f2bc37d68d of volume 5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:09:06 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d545b828-1565-4f99-b953-6d1b0521ae57 tempest-VolumesActionsTest-987572482 None] Created volume successfully. Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9411af8f-ce3d-4f2b-a3b4-8d54e276033d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:06 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 Apr 20 17:09:06 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (de991bac-9826-4b28-af92-a5497c208c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc0a3ba-80f8-4eaf-a081-195e1372c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc0a3ba-80f8-4eaf-a081-195e1372c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-407379559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76fce1b-8a4d-4b41-8255-5970d2161c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:07Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3bcf93-1c80-4c79-bde1-8c37a6ce4cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3bcf93-1c80-4c79-bde1-8c37a6ce4cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f16de5a-1b52-4b1f-828a-cbc88a45c4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f16de5a-1b52-4b1f-828a-cbc88a45c4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76fce1b-8a4d-4b41-8255-5970d2161c1a', 'volume_name': 'volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19a8fec-b6c3-43e4-86a7-72c6b2888928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19a8fec-b6c3-43e4-86a7-72c6b2888928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c239087-52c1-4d05-8165-014066cb8bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume c76fce1b-8a4d-4b41-8255-5970d2161c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a', 'volume_size': 1} Apr 20 17:09:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (ba16a65c-b427-41c6-b13f-5bec052f5a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c10f11-6374-4969-a24a-d7613f94e414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c10f11-6374-4969-a24a-d7613f94e414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1569165920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a443de9-60d8-4355-b858-67b12696ec89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:07Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034c5b29-5e35-40c0-a3a6-641c22ee1159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034c5b29-5e35-40c0-a3a6-641c22ee1159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bc91ae-f661-42b6-b598-8669cbeceddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bc91ae-f661-42b6-b598-8669cbeceddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a443de9-60d8-4355-b858-67b12696ec89', 'volume_name': 'volume-7a443de9-60d8-4355-b858-67b12696ec89', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009c1766-34bf-44df-8839-085fdd623e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009c1766-34bf-44df-8839-085fdd623e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c6644d-8128-4ec9-9278-9e68fd5db3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume 7a443de9-60d8-4355-b858-67b12696ec89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a443de9-60d8-4355-b858-67b12696ec89', 'volume_size': 1} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (0ee1ff3c-0ed9-4966-9cc5-abbda6e66f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7811f8c7-8bd4-4069-8d62-5e3879dd0083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7811f8c7-8bd4-4069-8d62-5e3879dd0083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-535841715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f69317a-26f9-43ce-8f17-6cae513d6fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:07Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0985bf95-acf0-4f98-86c6-6ce7fd02c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0985bf95-acf0-4f98-86c6-6ce7fd02c620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d501f5fa-d10c-47f2-8248-4cf7af39cd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d501f5fa-d10c-47f2-8248-4cf7af39cd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f69317a-26f9-43ce-8f17-6cae513d6fab', 'volume_name': 'volume-5f69317a-26f9-43ce-8f17-6cae513d6fab', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec52c1a-07ae-42ca-9b28-1e5483bd9eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec52c1a-07ae-42ca-9b28-1e5483bd9eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c319974-c0f8-4efc-b169-db57d931ddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume 5f69317a-26f9-43ce-8f17-6cae513d6fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f69317a-26f9-43ce-8f17-6cae513d6fab', 'volume_size': 1} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43" returned: 0 in 0.607s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bacb502-f4ad-4d18-9e65-0219151a02a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:07 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d 1G Apr 20 17:09:07 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (6e18861c-9add-42b9-8c8f-1e1a095050eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec5b65b-103c-46f2-b4e5-8960bb00664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec5b65b-103c-46f2-b4e5-8960bb00664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039732035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e347b9f-ac4b-43e7-901b-9c953f98e285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:07Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd71b4b-a99f-44d6-9564-9ba1f00e0a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd71b4b-a99f-44d6-9564-9ba1f00e0a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8da806-e49d-4046-accd-1dd0d0dc5d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8da806-e49d-4046-accd-1dd0d0dc5d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e347b9f-ac4b-43e7-901b-9c953f98e285', 'volume_name': 'volume-5e347b9f-ac4b-43e7-901b-9c953f98e285', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5384e0d-4e1f-487e-96b2-5c51e6d560f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5384e0d-4e1f-487e-96b2-5c51e6d560f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f22d566-4f85-4355-baa3-2069d9c06f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume 5e347b9f-ac4b-43e7-901b-9c953f98e285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e347b9f-ac4b-43e7-901b-9c953f98e285', 'volume_size': 1} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (12548c10-0a2c-4504-9b1f-a4019438950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923290ba-0f20-4146-9cdd-13366b0c5128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923290ba-0f20-4146-9cdd-13366b0c5128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1275080817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abec3dfd-bbdc-48ed-a183-0c16ab8df29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:08Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0478e044-3a94-4f57-b2b9-a5dfc56216ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0478e044-3a94-4f57-b2b9-a5dfc56216ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca85be9-1d32-41fc-918e-76b8fdb3913b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca85be9-1d32-41fc-918e-76b8fdb3913b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abec3dfd-bbdc-48ed-a183-0c16ab8df29d', 'volume_name': 'volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94caddf6-6e5c-4203-82de-a04f4d2fe00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94caddf6-6e5c-4203-82de-a04f4d2fe00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f0668d-518f-43bd-b728-5e48edc382f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:07 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume abec3dfd-bbdc-48ed-a183-0c16ab8df29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d', 'volume_size': 1} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:07 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d 1G" returned: 0 in 0.602s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:07 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d Apr 20 17:09:07 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Acquiring lock "cinder-fab9f168-42c6-494c-a014-0e2da790524d-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Lock "cinder-fab9f168-42c6-494c-a014-0e2da790524d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Acquiring lock "cinder-quobyte-fab9f168-42c6-494c-a014-0e2da790524d" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Lock "cinder-quobyte-fab9f168-42c6-494c-a014-0e2da790524d" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cece63-7f87-4937-b3cd-8e1e174ff0c3]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:08 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d Apr 20 17:09:08 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:08 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d" returned: 0 in 0.471s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:08 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d is being set with open permissions: ugo+rw Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:08 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d Apr 20 17:09:08 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:08 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:08 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d Apr 20 17:09:08 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:08 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d" returned: 0 in 0.424s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.976s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2575c03-b37b-4cf7-ac2e-0dfdc22964a3,created_at=2026-04-20T15:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-538180798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2575c03-b37b-4cf7-ac2e-0dfdc22964a3,host='devstack@QuobyteHD#QuobyteHD',id=259d7cf6-2c26-4cd6-b63f-9821a8f08760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c812b015a83480791018863335e1e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:05Z,use_quota=True,user_id='3888f2bdb6a7489eabb49e6c131544b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f93f050f-58fb-4001-9ca3-50cd3f8fa00a),volume_type_id=f93f050f-58fb-4001-9ca3-50cd3f8fa00a)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Creating volume 259d7cf6-2c26-4cd6-b63f-9821a8f08760 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:08 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:08 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 1073741824 Apr 20 17:09:08 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:08 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4b6e89df-8a18-46f1-ac8d-55dc5d04ac58 tempest-VolumesSnapshotListTestJSON-2095641407 None] Create snapshot completed successfully Apr 20 17:09:09 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fab9f168-42c6-494c-a014-0e2da790524d" returned: 0 in 0.438s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Lock "cinder-quobyte-fab9f168-42c6-494c-a014-0e2da790524d" released by "delete_volume" :: held 0.943s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Created reservations ['5db08b8b-823b-43a4-b52c-983ddc06076a', '5887be0c-1c00-4739-95a1-a7a7ec7c1e74', '5955aabf-90e1-4739-a473-cbc15047d5a3', '864dfeb6-8c17-4230-929c-c2e985dbd46b'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:09 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:09 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:09 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 1073741824" returned: 0 in 0.503s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:09 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 Apr 20 17:09:09 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:09 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Deleted volume successfully. Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7a65de33-0819-4d4d-a1b7-e48a1ecfad8e tempest-VolumesActionsTest-987572482 None] Lock "cinder-fab9f168-42c6-494c-a014-0e2da790524d-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:09 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760" returned: 0 in 0.454s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.838s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-407379559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76fce1b-8a4d-4b41-8255-5970d2161c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:07Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Creating volume c76fce1b-8a4d-4b41-8255-5970d2161c1a {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:09 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f1fa81-f97a-4a28-bf2d-71834d725cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:09 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a 1073741824 Apr 20 17:09:09 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b1e3d6-d810-4a47-a6e1-edf7489c4a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:09 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Volume volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 (259d7cf6-2c26-4cd6-b63f-9821a8f08760): created successfully Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b1e3d6-d810-4a47-a6e1-edf7489c4a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Flow 'volume_create_manager' (b21c5f0a-f744-4326-831d-2319d15ce78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-270175fe-86ef-471e-947c-c530029ba661 tempest-GroupsTest-1346586840 None] Created volume successfully. Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=240,cinder:SELECT=226,cinder:DELETE=19,cinder:INSERT=63 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:09:10 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a 1073741824" returned: 0 in 0.707s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Acquiring lock "cinder-quobyte-259d7cf6-2c26-4cd6-b63f-9821a8f08760" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Lock "cinder-quobyte-259d7cf6-2c26-4cd6-b63f-9821a8f08760" acquired by "delete_volume" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f043e3f-8b9d-4f63-baea-4f184494b901]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-2d796f1b-bcda-44b0-b4d8-80f2bc37d68d-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:10 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a Apr 20 17:09:10 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-2d796f1b-bcda-44b0-b4d8-80f2bc37d68d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-quobyte-2d796f1b-bcda-44b0-b4d8-80f2bc37d68d" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-2d796f1b-bcda-44b0-b4d8-80f2bc37d68d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Deleting offline snapshot 2d796f1b-bcda-44b0-b4d8-80f2bc37d68d of volume 5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:09:10 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 Apr 20 17:09:10 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] snapshot_file for this snap is: volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[669d1a77-0879-4782-a9a3-7d76af540f9f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:10 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d Apr 20 17:09:10 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:11 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a" returned: 0 in 0.510s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.946s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1569165920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a443de9-60d8-4355-b858-67b12696ec89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:07Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Creating volume 7a443de9-60d8-4355-b858-67b12696ec89 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:11 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:11 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c239087-52c1-4d05-8165-014066cb8bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:11 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 1073741824 Apr 20 17:09:11 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed900189-9aa2-40fd-8607-9f4fa24a3148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760" returned: 0 in 0.569s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:11 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a (c76fce1b-8a4d-4b41-8255-5970d2161c1a): created successfully Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed900189-9aa2-40fd-8607-9f4fa24a3148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:11 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (de991bac-9826-4b28-af92-a5497c208c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:11 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760 Apr 20 17:09:11 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d" returned: 0 in 0.524s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bacb502-f4ad-4d18-9e65-0219151a02a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:11 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7ae0a554-8a7e-44f9-b338-f35508e437c4 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created volume successfully. Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dddc022-d4a5-4b5f-8aa4-4fe1f8ddec1b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:11 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 Apr 20 17:09:11 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:11 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-259d7cf6-2c26-4cd6-b63f-9821a8f08760" returned: 0 in 0.565s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Lock "cinder-quobyte-259d7cf6-2c26-4cd6-b63f-9821a8f08760" released by "delete_volume" :: held 1.160s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:11 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 1073741824" returned: 0 in 0.631s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:11 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 Apr 20 17:09:11 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Created reservations ['6b5e3e8e-d145-4a95-9599-e3550a55e60f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:11 devstack cinder-volume[82240]: WARNING cinder.quota [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-629755435 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-629755435, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:09:11 devstack cinder-volume[82240]: WARNING cinder.quota [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-629755435 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-629755435, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Created reservations ['d12ac54d-88af-489c-9c17-02898423ab12', '2710ed06-9c7b-49ea-b74c-b805a6ced11b', 'bd3d8d49-2b43-4955-9bcf-bbfaf920fa3b', 'f76b6924-e286-48a7-aa59-cdfe0d026b56'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:11 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43" returned: 0 in 0.646s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bacb502-f4ad-4d18-9e65-0219151a02a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:11 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d Apr 20 17:09:11 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:11 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:11 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:12 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89" returned: 0 in 0.572s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.059s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-535841715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f69317a-26f9-43ce-8f17-6cae513d6fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:07Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Creating volume 5f69317a-26f9-43ce-8f17-6cae513d6fab {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:12 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c6644d-8128-4ec9-9278-9e68fd5db3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a443de9-60d8-4355-b858-67b12696ec89', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b4af3c-80b4-4ccd-a5dd-ec6f25bc7dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:12 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d" returned: 0 in 0.547s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:12 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab 1073741824 Apr 20 17:09:12 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:12 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume volume-7a443de9-60d8-4355-b858-67b12696ec89 (7a443de9-60d8-4355-b858-67b12696ec89): created successfully Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b4af3c-80b4-4ccd-a5dd-ec6f25bc7dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:12 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (ba16a65c-b427-41c6-b13f-5bec052f5a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.496s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:12 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d Apr 20 17:09:12 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:12 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9f535054-e25a-42e4-a1f5-07782727cb5b tempest-GroupsTest-1346586840 None] Delete group completed successfully. Apr 20 17:09:12 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a59856cc-9d58-490d-b31d-d213c317aa32 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created volume successfully. Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Created reservations ['f3b56bce-a351-491d-94ca-742bdc2b10a4'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:12 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:12 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:12 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.2d796f1b-bcda-44b0-b4d8-80f2bc37d68d" returned: 0 in 0.525s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:12 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-2d796f1b-bcda-44b0-b4d8-80f2bc37d68d" released by "_delete_snapshot" :: held 2.295s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab 1073741824" returned: 0 in 0.580s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" released by "delete_snapshot" :: held 2.313s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:12 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab Apr 20 17:09:12 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:12 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Created reservations ['55e12108-0a21-4413-be17-64e0bbd5cc4f', '3814fd16-69df-473f-8e9b-100218e821ce', '3c477ed7-0a4a-4688-bd02-c5c0d98a6f86', '2b38cb63-8a06-4a19-ba70-4358a20d822f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:13 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Delete snapshot completed successfully. Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-56cf2c4c-ec84-40c9-a5c5-3b2d902e0905 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-2d796f1b-bcda-44b0-b4d8-80f2bc37d68d-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:13 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.510s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:13 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-afda0c4f-e6c1-48fc-827a-df468f8f35c9 tempest-GroupsTest-1346586840 None] Delete group completed successfully. Apr 20 17:09:13 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab" returned: 0 in 0.495s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.975s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039732035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e347b9f-ac4b-43e7-901b-9c953f98e285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:07Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Creating volume 5e347b9f-ac4b-43e7-901b-9c953f98e285 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:13 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c319974-c0f8-4efc-b169-db57d931ddbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f69317a-26f9-43ce-8f17-6cae513d6fab', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:13 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 1073741824 Apr 20 17:09:13 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cf3649-271e-4a1c-b161-ad2997f1bc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:13 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume volume-5f69317a-26f9-43ce-8f17-6cae513d6fab (5f69317a-26f9-43ce-8f17-6cae513d6fab): created successfully Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cf3649-271e-4a1c-b161-ad2997f1bc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (0ee1ff3c-0ed9-4966-9cc5-abbda6e66f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:13 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4f69c404-2f29-406d-a0f4-704130b21446 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created volume successfully. Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-760d7b9a-6cd2-4046-8b03-a11e57bfea43-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-760d7b9a-6cd2-4046-8b03-a11e57bfea43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-quobyte-760d7b9a-6cd2-4046-8b03-a11e57bfea43" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-760d7b9a-6cd2-4046-8b03-a11e57bfea43" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Deleting offline snapshot 760d7b9a-6cd2-4046-8b03-a11e57bfea43 of volume 5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] snapshot_file for this snap is: volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a4c44-fd5e-456b-9daa-8c54eb752d8d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:14 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 Apr 20 17:09:14 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:14 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 1073741824" returned: 0 in 0.694s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:14 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 Apr 20 17:09:14 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-28ca66b4-12c3-414e-b255-9d0747fdbdb8 tempest-GroupsTest-1346586840 None] Group tempest-GroupsTest-Group-1151985115: creating Apr 20 17:09:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-28ca66b4-12c3-414e-b255-9d0747fdbdb8 tempest-GroupsTest-1346586840 None] Group tempest-GroupsTest-Group-1151985115: created successfully Apr 20 17:09:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-28ca66b4-12c3-414e-b255-9d0747fdbdb8 tempest-GroupsTest-1346586840 None] Create group completed successfully. Apr 20 17:09:14 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43" returned: 0 in 0.587s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bacb502-f4ad-4d18-9e65-0219151a02a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e2fa8-1f5d-4e84-8058-b92e9601daba]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:14 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 Apr 20 17:09:14 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:14 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285" returned: 0 in 0.551s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.100s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1275080817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abec3dfd-bbdc-48ed-a183-0c16ab8df29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bdd820d4dc4fbdba7152f9de2b3e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:08Z,use_quota=True,user_id='9c60f7c575614ccbb4e14580e973185b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Creating volume abec3dfd-bbdc-48ed-a183-0c16ab8df29d {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:14 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f22d566-4f85-4355-baa3-2069d9c06f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e347b9f-ac4b-43e7-901b-9c953f98e285', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06d4ce8-a12d-44c4-b717-b95858b3a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:14 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 (5e347b9f-ac4b-43e7-901b-9c953f98e285): created successfully Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06d4ce8-a12d-44c4-b717-b95858b3a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (6e18861c-9add-42b9-8c8f-1e1a095050eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:14 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d 1073741824 Apr 20 17:09:14 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-980721f3-92ac-4c73-8f49-af63e940f8ce tempest-CreateVolumesFromSnapshotTest-854420740 None] Created volume successfully. Apr 20 17:09:15 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702" returned: 0 in 0.570s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bacb502-f4ad-4d18-9e65-0219151a02a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:15 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 Apr 20 17:09:15 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:15 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d 1073741824" returned: 0 in 0.638s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:15 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d Apr 20 17:09:15 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:15 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43" returned: 0 in 0.552s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:15 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43 Apr 20 17:09:15 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Flow 'volume_create_manager' (3fd9a0a5-763f-4dd5-9437-ace5795f708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705511d1-3d7d-45b5-8f57-78922c148a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705511d1-3d7d-45b5-8f57-78922c148a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-588479767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5390fb3b-f9e2-4a64-86fd-5c0b387b3ad4,host='devstack@QuobyteHD#QuobyteHD',id=3415d806-96aa-4b01-86a1-5e6358ac8ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c812b015a83480791018863335e1e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:16Z,use_quota=True,user_id='3888f2bdb6a7489eabb49e6c131544b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9af6e6a-a559-448e-b026-1088c26ce5a3),volume_type_id=f9af6e6a-a559-448e-b026-1088c26ce5a3)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97969941-f6ef-419f-91a8-43690194c83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97969941-f6ef-419f-91a8-43690194c83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8229973-0b4b-436e-b04b-6c1a5d6363f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8229973-0b4b-436e-b04b-6c1a5d6363f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3415d806-96aa-4b01-86a1-5e6358ac8ba0', 'volume_name': 'volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89b4859-c113-4035-9c40-d648ef60376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89b4859-c113-4035-9c40-d648ef60376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034d087e-3895-40d5-828e-e68c48d6e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:15 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Volume 3415d806-96aa-4b01-86a1-5e6358ac8ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0', 'volume_size': 1} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:15 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d" returned: 0 in 0.553s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5390fb3b-f9e2-4a64-86fd-5c0b387b3ad4,created_at=2026-04-20T15:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-588479767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5390fb3b-f9e2-4a64-86fd-5c0b387b3ad4,host='devstack@QuobyteHD#QuobyteHD',id=3415d806-96aa-4b01-86a1-5e6358ac8ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c812b015a83480791018863335e1e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:16Z,use_quota=True,user_id='3888f2bdb6a7489eabb49e6c131544b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9af6e6a-a559-448e-b026-1088c26ce5a3),volume_type_id=f9af6e6a-a559-448e-b026-1088c26ce5a3)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Creating volume 3415d806-96aa-4b01-86a1-5e6358ac8ba0 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:15 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f0668d-518f-43bd-b728-5e48edc382f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:16 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 1073741824 Apr 20 17:09:16 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9777f2c-55ca-4643-b7b1-bd6fe2d4448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:16 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Volume volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d (abec3dfd-bbdc-48ed-a183-0c16ab8df29d): created successfully Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9777f2c-55ca-4643-b7b1-bd6fe2d4448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Flow 'volume_create_manager' (12548c10-0a2c-4504-9b1f-a4019438950d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:16 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-665e3638-429b-4a2d-9f7b-aa513239a3e1 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created volume successfully. Apr 20 17:09:16 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.760d7b9a-6cd2-4046-8b03-a11e57bfea43" returned: 0 in 0.519s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-760d7b9a-6cd2-4046-8b03-a11e57bfea43" released by "_delete_snapshot" :: held 2.306s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" released by "delete_snapshot" :: held 2.339s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Created reservations ['89b39915-7618-43c3-a1ed-62bb16f098ca', '9182a44d-9527-4e6b-9927-b8b29587f53c', 'da449908-b95c-4943-8961-c2a6e6143528', '0bb6edda-c883-4786-8fef-477362555e24'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:16 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Delete snapshot completed successfully. Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3c3477d5-5c11-4041-bf48-337d9d8a4a88 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-760d7b9a-6cd2-4046-8b03-a11e57bfea43-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-abec3dfd-bbdc-48ed-a183-0c16ab8df29d-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-abec3dfd-bbdc-48ed-a183-0c16ab8df29d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-quobyte-abec3dfd-bbdc-48ed-a183-0c16ab8df29d" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-abec3dfd-bbdc-48ed-a183-0c16ab8df29d" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c59b4a-ffa5-485c-98ce-78046c1ee16c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:16 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 1073741824" returned: 0 in 0.567s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:16 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d Apr 20 17:09:16 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:16 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 Apr 20 17:09:16 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:16 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0" returned: 0 in 0.412s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:16 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034d087e-3895-40d5-828e-e68c48d6e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561dd34b-447e-4fd4-93a0-4c07849409f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-b3765783-c011-4b83-ab3f-6829ce2c9702-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:17 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Volume volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 (3415d806-96aa-4b01-86a1-5e6358ac8ba0): created successfully Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561dd34b-447e-4fd4-93a0-4c07849409f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Flow 'volume_create_manager' (3fd9a0a5-763f-4dd5-9437-ace5795f708a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-b3765783-c011-4b83-ab3f-6829ce2c9702-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-quobyte-b3765783-c011-4b83-ab3f-6829ce2c9702" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:17 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-69be3617-f044-4604-b87d-75a0453a345f tempest-GroupsTest-1346586840 None] Created volume successfully. Apr 20 17:09:17 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-b3765783-c011-4b83-ab3f-6829ce2c9702" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Deleting offline snapshot b3765783-c011-4b83-ab3f-6829ce2c9702 of volume 5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] snapshot_file for this snap is: volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d" returned: 0 in 0.565s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a9d04-e1d8-4f69-99fe-d49449e0e1ae]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:17 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d Apr 20 17:09:17 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:17 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 Apr 20 17:09:17 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:17 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-abec3dfd-bbdc-48ed-a183-0c16ab8df29d" returned: 0 in 0.450s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-abec3dfd-bbdc-48ed-a183-0c16ab8df29d" released by "delete_volume" :: held 1.044s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Created reservations ['2570cc94-54ac-40d8-b962-b3e2b647bc3f', '377a37ee-2511-483d-945d-d3cb4dc2ad26', 'a5840a11-1f74-48fc-afe4-ae085d4ac9bb', '73d099b1-d771-4339-9d68-a86ce83c7ea1'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:17 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702" returned: 0 in 0.536s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bacb502-f4ad-4d18-9e65-0219151a02a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2c0fcc-2ca4-4759-9742-a76796cb0f67]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:17 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:17 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:17 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 Apr 20 17:09:17 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:18 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.465s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:18 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Deleted volume successfully. Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1eaad530-2ec8-4df4-bb3e-5301a7aaf52c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-abec3dfd-bbdc-48ed-a183-0c16ab8df29d-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Flow 'volume_create_manager' (ed00e150-875e-4b09-b07f-239262ae7cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e53c09-a006-45ad-96d8-155a72c9f932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e53c09-a006-45ad-96d8-155a72c9f932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-574309663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5390fb3b-f9e2-4a64-86fd-5c0b387b3ad4,host='devstack@QuobyteHD#QuobyteHD',id=8d844d89-7710-4dbc-89f2-2630c54c9921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c812b015a83480791018863335e1e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:18Z,use_quota=True,user_id='3888f2bdb6a7489eabb49e6c131544b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9af6e6a-a559-448e-b026-1088c26ce5a3),volume_type_id=f9af6e6a-a559-448e-b026-1088c26ce5a3)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cee381-26ba-4b4c-b5b6-2c9b1a81a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cee381-26ba-4b4c-b5b6-2c9b1a81a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d18c90-2f50-4912-9c17-f9a9b2d33e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d18c90-2f50-4912-9c17-f9a9b2d33e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d844d89-7710-4dbc-89f2-2630c54c9921', 'volume_name': 'volume-8d844d89-7710-4dbc-89f2-2630c54c9921', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff4d00d-10a7-46aa-a739-af9e732fd91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:18 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff4d00d-10a7-46aa-a739-af9e732fd91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a059a025-0b69-414b-a982-ba1d06be736e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:18 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Volume 8d844d89-7710-4dbc-89f2-2630c54c9921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d844d89-7710-4dbc-89f2-2630c54c9921', 'volume_size': 1} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5390fb3b-f9e2-4a64-86fd-5c0b387b3ad4,created_at=2026-04-20T15:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-574309663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5390fb3b-f9e2-4a64-86fd-5c0b387b3ad4,host='devstack@QuobyteHD#QuobyteHD',id=8d844d89-7710-4dbc-89f2-2630c54c9921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c812b015a83480791018863335e1e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:18Z,use_quota=True,user_id='3888f2bdb6a7489eabb49e6c131544b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9af6e6a-a559-448e-b026-1088c26ce5a3),volume_type_id=f9af6e6a-a559-448e-b026-1088c26ce5a3)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Creating volume 8d844d89-7710-4dbc-89f2-2630c54c9921 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:18 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4" returned: 0 in 0.686s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:18 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 1073741824 Apr 20 17:09:18 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:18 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 Apr 20 17:09:18 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-5e347b9f-ac4b-43e7-901b-9c953f98e285-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-5e347b9f-ac4b-43e7-901b-9c953f98e285-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-quobyte-5e347b9f-ac4b-43e7-901b-9c953f98e285" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-5e347b9f-ac4b-43e7-901b-9c953f98e285" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bf3a4d-f57f-48b4-8de5-fc170b010396]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:18 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702" returned: 0 in 0.500s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:18 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 Apr 20 17:09:18 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:18 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702 Apr 20 17:09:18 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:18 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 1073741824" returned: 0 in 0.553s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:18 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 Apr 20 17:09:18 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:18 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Flow 'volume_create_manager' (80d0973e-0d7c-4970-8b97-e10a90898121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd5e6e7-67c2-425a-a699-1f3cc971f465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd5e6e7-67c2-425a-a699-1f3cc971f465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-422037902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f162db06-e925-4a6f-a00d-5cec46f1c665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8949c2309c4c1aae21814f078c753d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:19Z,use_quota=True,user_id='2a88350611c04bcf8e44f754bbd6cc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92460279-3a29-4e68-89b4-a791a0b3d03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92460279-3a29-4e68-89b4-a791a0b3d03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17510f7-7774-44fb-bb3b-b8cc70911581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17510f7-7774-44fb-bb3b-b8cc70911581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f162db06-e925-4a6f-a00d-5cec46f1c665', 'volume_name': 'volume-f162db06-e925-4a6f-a00d-5cec46f1c665', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0088bc82-035b-4951-9f67-52cbade797a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0088bc82-035b-4951-9f67-52cbade797a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f62c8d4-224b-4998-a7b6-69df8d46f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:19 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Volume f162db06-e925-4a6f-a00d-5cec46f1c665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f162db06-e925-4a6f-a00d-5cec46f1c665', 'volume_size': 1} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:19 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4.b3765783-c011-4b83-ab3f-6829ce2c9702" returned: 0 in 0.432s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-b3765783-c011-4b83-ab3f-6829ce2c9702" released by "_delete_snapshot" :: held 2.234s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" released by "delete_snapshot" :: held 2.253s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Created reservations ['4cec964f-b5e8-46fc-9b81-2f53365c8558', 'a61305d2-d63f-4e97-9941-178c0bcef501', '1c0e7282-409a-41fa-ae8f-51fdedd36bea', '6ede3832-03e4-4513-b33a-fc65e3ba28b1'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:19 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285" returned: 0 in 0.594s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:19 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285 Apr 20 17:09:19 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:19 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Delete snapshot completed successfully. Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ac84122b-594b-47fa-bbd8-fc15e1edd74f tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-b3765783-c011-4b83-ab3f-6829ce2c9702-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:19 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921" returned: 0 in 0.539s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-422037902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f162db06-e925-4a6f-a00d-5cec46f1c665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8949c2309c4c1aae21814f078c753d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:19Z,use_quota=True,user_id='2a88350611c04bcf8e44f754bbd6cc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Creating volume f162db06-e925-4a6f-a00d-5cec46f1c665 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:19 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a059a025-0b69-414b-a982-ba1d06be736e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d844d89-7710-4dbc-89f2-2630c54c9921', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9982436-04eb-4847-8cd4-4f75254136c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:19 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 1073741824 Apr 20 17:09:19 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:19 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Volume volume-8d844d89-7710-4dbc-89f2-2630c54c9921 (8d844d89-7710-4dbc-89f2-2630c54c9921): created successfully Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9982436-04eb-4847-8cd4-4f75254136c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Flow 'volume_create_manager' (ed00e150-875e-4b09-b07f-239262ae7cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:19 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-943f8466-c5fe-4726-832a-7d6881c2a655 tempest-GroupsTest-1346586840 None] Created volume successfully. Apr 20 17:09:19 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5e347b9f-ac4b-43e7-901b-9c953f98e285" returned: 0 in 0.414s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-5e347b9f-ac4b-43e7-901b-9c953f98e285" released by "delete_volume" :: held 1.040s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created reservations ['37707ef3-d3c6-43a9-9245-4764eee050f6', '93c6d987-48cc-44c7-9d68-ef26e4b45bad', 'a51d53d2-5b1a-432f-812b-74efe1768ac7', '0e497702-8b3b-421b-a696-d34409963581'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:19 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:19 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:19 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 1073741824" returned: 0 in 0.490s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:19 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 Apr 20 17:09:19 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-5bacb502-f4ad-4d18-9e65-0219151a02a4-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-5bacb502-f4ad-4d18-9e65-0219151a02a4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" acquired by "delete_volume" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7161ed-8cf6-4b34-b86f-cdedad094bf6]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:20 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 Apr 20 17:09:20 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:20 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.468s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Deleted volume successfully. Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6a5ce8aa-b422-4d50-a5b9-f9289128c274 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-5e347b9f-ac4b-43e7-901b-9c953f98e285-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:20 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665" returned: 0 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f62c8d4-224b-4998-a7b6-69df8d46f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f162db06-e925-4a6f-a00d-5cec46f1c665', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775ad819-fc56-4971-868d-72d627f4b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:20 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Volume volume-f162db06-e925-4a6f-a00d-5cec46f1c665 (f162db06-e925-4a6f-a00d-5cec46f1c665): created successfully Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775ad819-fc56-4971-868d-72d627f4b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Flow 'volume_create_manager' (80d0973e-0d7c-4970-8b97-e10a90898121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0a271610-1f37-4858-8726-5a3235d9873e tempest-AbsoluteLimitsTests-533776785 None] Created volume successfully. Apr 20 17:09:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-6220fb66-3ff9-4b66-854f-cccc8fb9db79 tempest-GroupsTest-1346586840 None] Update group completed successfully. Apr 20 17:09:20 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4" returned: 0 in 0.501s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:20 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4 Apr 20 17:09:20 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-5f69317a-26f9-43ce-8f17-6cae513d6fab-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-5f69317a-26f9-43ce-8f17-6cae513d6fab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-quobyte-5f69317a-26f9-43ce-8f17-6cae513d6fab" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-5f69317a-26f9-43ce-8f17-6cae513d6fab" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf816d8-7900-4560-8f0b-3c10e669c2e8]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:21 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab Apr 20 17:09:21 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Acquiring lock "cinder-f162db06-e925-4a6f-a00d-5cec46f1c665-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:21 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5bacb502-f4ad-4d18-9e65-0219151a02a4" returned: 0 in 0.500s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Lock "cinder-f162db06-e925-4a6f-a00d-5cec46f1c665-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-quobyte-5bacb502-f4ad-4d18-9e65-0219151a02a4" released by "delete_volume" :: held 1.042s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Acquiring lock "cinder-quobyte-f162db06-e925-4a6f-a00d-5cec46f1c665" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Lock "cinder-quobyte-f162db06-e925-4a6f-a00d-5cec46f1c665" acquired by "delete_volume" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ca4cb1-c9e2-4ff7-834c-9d1533693edd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Created reservations ['c6017482-b34f-4a88-9beb-b1bc90a674fc', 'bde0bcbd-a76c-4425-82ef-1528215c8cc9', '420e0f33-05bc-4634-a3cf-d1db8a9991c0', '9f42b97a-c951-45ae-9a5f-16ec4daa4cfe'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:21 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 Apr 20 17:09:21 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:21 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:21 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:21 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab" returned: 0 in 0.544s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:21 devstack sudo[87998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab Apr 20 17:09:21 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:21 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-fef2b4be-dd58-46c7-af8c-1f46179f8cfa tempest-GroupsTest-1346586840 None] Update group completed successfully. Apr 20 17:09:21 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665" returned: 0 in 0.521s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:21 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665 Apr 20 17:09:21 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:21 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.503s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:21 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Deleted volume successfully. Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f823853-f37a-4df3-ad81-92634defec55 tempest-VolumesSnapshotListTestJSON-2095641407 None] Lock "cinder-5bacb502-f4ad-4d18-9e65-0219151a02a4-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:21 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5f69317a-26f9-43ce-8f17-6cae513d6fab" returned: 0 in 0.462s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-5f69317a-26f9-43ce-8f17-6cae513d6fab" released by "delete_volume" :: held 1.028s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:21 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Created reservations ['353619a5-2842-4af4-8f40-d58cee3702f1', 'ebad5b52-a76f-4de0-9968-9c1904eab1f1', '75edb512-4ce7-4878-b326-c59da5a1d9b9', '5766ac96-46e2-42af-813b-413a3642f8ea'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:22 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:22 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:22 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f162db06-e925-4a6f-a00d-5cec46f1c665" returned: 0 in 0.432s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Lock "cinder-quobyte-f162db06-e925-4a6f-a00d-5cec46f1c665" released by "delete_volume" :: held 0.980s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Created reservations ['cb932fe7-1f45-4b2d-a044-cbbc243b3098', 'a7690b72-869a-4baf-8983-627ec708dcc7', 'bf3b1a6c-cbc8-4a3c-bb83-7aa1bda22909', 'a2f7f276-253d-4c04-bc04-02019139f78d'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:22 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:22 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:22 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.444s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:22 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Deleted volume successfully. Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-89de9b79-d3db-495d-ab89-cd7ffcfab91c tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-5f69317a-26f9-43ce-8f17-6cae513d6fab-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:22 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:22 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Deleted volume successfully. Apr 20 17:09:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c5cecf09-1ee2-46b0-a504-de1319ff38a6 tempest-AbsoluteLimitsTests-533776785 None] Lock "cinder-f162db06-e925-4a6f-a00d-5cec46f1c665-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-7a443de9-60d8-4355-b858-67b12696ec89-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Acquiring lock "cinder-quobyte-3415d806-96aa-4b01-86a1-5e6358ac8ba0" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-7a443de9-60d8-4355-b858-67b12696ec89-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Lock "cinder-quobyte-3415d806-96aa-4b01-86a1-5e6358ac8ba0" acquired by "delete_volume" :: waited 0.040s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b218362-31ee-4ac8-8302-b65843caf7e1]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=273,cinder:INSERT=73,cinder:UPDATE=346,cinder:DELETE=26 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-quobyte-7a443de9-60d8-4355-b858-67b12696ec89" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-7a443de9-60d8-4355-b858-67b12696ec89" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bff8528-2efa-405b-9a26-aa5f2775b121]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:23 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 Apr 20 17:09:23 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:23 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 Apr 20 17:09:23 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:23 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0" returned: 0 in 0.513s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:23 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0 Apr 20 17:09:23 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:23 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89" returned: 0 in 0.554s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:23 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89 Apr 20 17:09:23 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:24 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-3415d806-96aa-4b01-86a1-5e6358ac8ba0" returned: 0 in 0.502s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Lock "cinder-quobyte-3415d806-96aa-4b01-86a1-5e6358ac8ba0" released by "delete_volume" :: held 1.050s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Acquiring lock "cinder-quobyte-8d844d89-7710-4dbc-89f2-2630c54c9921" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Lock "cinder-quobyte-8d844d89-7710-4dbc-89f2-2630c54c9921" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fe5ddb-c5da-44dc-ac95-a100a2b55d1c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:24 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 Apr 20 17:09:24 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:24 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7a443de9-60d8-4355-b858-67b12696ec89" returned: 0 in 0.567s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-7a443de9-60d8-4355-b858-67b12696ec89" released by "delete_volume" :: held 1.169s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created reservations ['2cdab35e-3c98-4160-b0cd-8e059df66db5', '70b7e2d5-efe8-48ea-a2fd-d3b4dc4d69a6', '9ed0c09c-c784-42e2-acde-39c57b114104', 'b2c1375d-ed2f-4234-a242-30a181a70c8e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Flow 'volume_create_manager' (1e11e817-5f0e-423c-92b4-b1af99cc9e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2373d5-fc3d-49de-a30b-5477cea64105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2373d5-fc3d-49de-a30b-5477cea64105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505f63ce-22a8-468e-8dd3-13e9eaf8b3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854bce1fa4b64b048bd48038917388e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:24Z,use_quota=True,user_id='43e6459d08d74dee9b0b75398c39565d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec072f77-9ce4-4f8c-a97e-4a442de2f87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec072f77-9ce4-4f8c-a97e-4a442de2f87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248b7fde-ceef-4230-8477-df6d97706015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248b7fde-ceef-4230-8477-df6d97706015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505f63ce-22a8-468e-8dd3-13e9eaf8b3f0', 'volume_name': 'volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9cd742-245f-476a-93e7-7484e0f86a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9cd742-245f-476a-93e7-7484e0f86a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975b817e-3291-4228-bbd8-2c831718127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:24 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Volume 505f63ce-22a8-468e-8dd3-13e9eaf8b3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0', 'volume_size': 1} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505f63ce-22a8-468e-8dd3-13e9eaf8b3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854bce1fa4b64b048bd48038917388e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:24Z,use_quota=True,user_id='43e6459d08d74dee9b0b75398c39565d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Creating volume 505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:24 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:24 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 1073741824 Apr 20 17:09:24 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:24 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:24 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:24 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921" returned: 0 in 0.721s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:24 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921 Apr 20 17:09:24 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:25 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.499s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Deleted volume successfully. Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-161db9a1-069e-4f3f-b495-12dc30b107c5 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-7a443de9-60d8-4355-b858-67b12696ec89-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:25 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 1073741824" returned: 0 in 0.691s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:25 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 Apr 20 17:09:25 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-c76fce1b-8a4d-4b41-8255-5970d2161c1a-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-c76fce1b-8a4d-4b41-8255-5970d2161c1a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-quobyte-c76fce1b-8a4d-4b41-8255-5970d2161c1a" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-c76fce1b-8a4d-4b41-8255-5970d2161c1a" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d3b1b0-c5c0-4dca-8729-448e47802a12]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:25 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8d844d89-7710-4dbc-89f2-2630c54c9921" returned: 0 in 0.557s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Lock "cinder-quobyte-8d844d89-7710-4dbc-89f2-2630c54c9921" released by "delete_volume" :: held 1.307s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:25 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a Apr 20 17:09:25 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Created reservations ['31e9ecd6-ef6a-401d-8a99-b296888e4575'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:25 devstack cinder-volume[82240]: WARNING cinder.quota [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1210477648 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1210477648, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:09:25 devstack cinder-volume[82240]: WARNING cinder.quota [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1210477648 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1210477648, it is now deprecated. Please use the default quota class for default quota. Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Created reservations ['f63e15e2-ae8c-469c-adf8-7bd008207ff5', 'dd214e45-234e-4acb-832d-1dc576e6cf55', 'cc8183fb-08ce-4e52-a7a9-8e9c68e3f870', '6becdab0-63e6-471d-bde3-c904434fe9ef'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Created reservations ['ed55626b-c3f0-4843-aa84-34bb842e0b97', '8f57f5b6-c57a-4aaf-9e91-242c8d68aae6', '6a09a0b8-b947-4203-85ad-358c74f11dc1', '60dee104-6998-46a1-b7cb-b513ff087199'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:25 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:25 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:25 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0" returned: 0 in 0.539s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975b817e-3291-4228-bbd8-2c831718127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286c7219-0737-450b-9258-478a7fe0e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:25 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Volume volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 (505f63ce-22a8-468e-8dd3-13e9eaf8b3f0): created successfully Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286c7219-0737-450b-9258-478a7fe0e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Flow 'volume_create_manager' (1e11e817-5f0e-423c-92b4-b1af99cc9e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a67da96f-d6a8-44c0-a2a0-baa84a811455 tempest-CinderUnicodeTest-2065568543 None] Created volume successfully. Apr 20 17:09:25 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a" returned: 0 in 0.500s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:25 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a Apr 20 17:09:25 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:26 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.503s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:26 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-cfcaa8ff-e6e1-4b2d-8ff2-5feb2ba4afc6 tempest-GroupsTest-1346586840 None] Delete group completed successfully. Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Flow 'volume_create_manager' (2b6f3a49-e39b-4de6-81f3-73023ba5056f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680c1021-3f13-4362-9a74-5c09a15e16a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680c1021-3f13-4362-9a74-5c09a15e16a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1025428636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e23e75a-924a-4b08-bcfe-a658a3306daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e63afb2f8dd4d44ab8caa9255055d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:26Z,use_quota=True,user_id='c55064da57674c46a6a0110e42a5406a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c04b03-4a7e-4c3b-89df-f03f9d7f41fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c04b03-4a7e-4c3b-89df-f03f9d7f41fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ff52b6-5082-4e51-a676-f43d50c2a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ff52b6-5082-4e51-a676-f43d50c2a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e23e75a-924a-4b08-bcfe-a658a3306daa', 'volume_name': 'volume-0e23e75a-924a-4b08-bcfe-a658a3306daa', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb03af85-49d6-42bd-9f6e-9b94f4d5aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb03af85-49d6-42bd-9f6e-9b94f4d5aca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb6901c-ee8c-4421-bad0-b0949e26dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:26 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Volume 0e23e75a-924a-4b08-bcfe-a658a3306daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e23e75a-924a-4b08-bcfe-a658a3306daa', 'volume_size': 1} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1025428636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e23e75a-924a-4b08-bcfe-a658a3306daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e63afb2f8dd4d44ab8caa9255055d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:26Z,use_quota=True,user_id='c55064da57674c46a6a0110e42a5406a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Creating volume 0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:26 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:26 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa 1073741824 Apr 20 17:09:26 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:26 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c76fce1b-8a4d-4b41-8255-5970d2161c1a" returned: 0 in 0.447s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-c76fce1b-8a4d-4b41-8255-5970d2161c1a" released by "delete_volume" :: held 0.978s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created reservations ['d54d4693-802d-452a-a7e0-240588225c29', '1b1ade90-a9a0-4dc9-a89c-8fc12543a31f', 'f486a93c-737a-431c-902b-97769bfb5383', '84367cc9-c168-458d-ac11-4a28022b92a5'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:26 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:26 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-951652bf-0276-4e85-ab28-77d44aa72358-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-951652bf-0276-4e85-ab28-77d44aa72358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-quobyte-538d92b5-9c60-47e8-8506-94a955e64b0d" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-538d92b5-9c60-47e8-8506-94a955e64b0d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-quobyte-951652bf-0276-4e85-ab28-77d44aa72358" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-951652bf-0276-4e85-ab28-77d44aa72358" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Deleting offline snapshot 951652bf-0276-4e85-ab28-77d44aa72358 of volume 538d92b5-9c60-47e8-8506-94a955e64b0d {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] snapshot_file for this snap is: volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9129fbc-460f-4ffc-b513-c5b107578a63]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:26 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 Apr 20 17:09:26 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Flow 'volume_create_manager' (7feb6663-66eb-4fed-9bc0-6e48cbfeeb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef24055e-a0c4-44fe-93a4-532d8cbdaa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:27 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:27 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef24055e-a0c4-44fe-93a4-532d8cbdaa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1143223316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee013b1-af74-4799-91a9-66d975bccfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854bce1fa4b64b048bd48038917388e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:27Z,use_quota=True,user_id='43e6459d08d74dee9b0b75398c39565d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45be2bab-8b7c-4b09-94be-bf6b6091c394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45be2bab-8b7c-4b09-94be-bf6b6091c394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c527bb-bd8b-404f-94d8-44c14af2e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c527bb-bd8b-404f-94d8-44c14af2e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee013b1-af74-4799-91a9-66d975bccfa9', 'volume_name': 'volume-9ee013b1-af74-4799-91a9-66d975bccfa9', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88c159c-f9ef-4f89-b185-34fc8e13485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88c159c-f9ef-4f89-b185-34fc8e13485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd58af20-bb2f-45de-8da6-048f2d3668d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:27 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Volume 9ee013b1-af74-4799-91a9-66d975bccfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee013b1-af74-4799-91a9-66d975bccfa9', 'volume_size': 1} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa 1073741824" returned: 0 in 0.749s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.605s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:27 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Deleted volume successfully. Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ce8ad7a2-82ab-4595-a536-8e44c7329740 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-c76fce1b-8a4d-4b41-8255-5970d2161c1a-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:27 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa Apr 20 17:09:27 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:27 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358" returned: 0 in 0.653s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-538d92b5-9c60-47e8-8506-94a955e64b0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[036c1a70-353c-49cb-ba0c-7c8041e91fd7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:27 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d Apr 20 17:09:27 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:27 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1143223316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee013b1-af74-4799-91a9-66d975bccfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854bce1fa4b64b048bd48038917388e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:27Z,use_quota=True,user_id='43e6459d08d74dee9b0b75398c39565d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Creating volume 9ee013b1-af74-4799-91a9-66d975bccfa9 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:27 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:27 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 1073741824 Apr 20 17:09:27 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb6901c-ee8c-4421-bad0-b0949e26dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e23e75a-924a-4b08-bcfe-a658a3306daa', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1c18c6-bbb5-4d59-9221-aa76b9ee07f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:27 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Volume volume-0e23e75a-924a-4b08-bcfe-a658a3306daa (0e23e75a-924a-4b08-bcfe-a658a3306daa): created successfully Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1c18c6-bbb5-4d59-9221-aa76b9ee07f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Flow 'volume_create_manager' (2b6f3a49-e39b-4de6-81f3-73023ba5056f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:27 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b1b8aac2-03e6-4230-b44d-e7ac34e752bb tempest-VolumesDeleteCascade-1406849053 None] Created volume successfully. Apr 20 17:09:27 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d" returned: 0 in 0.531s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:27 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 Apr 20 17:09:27 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:28 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 1073741824" returned: 0 in 0.568s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:28 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 Apr 20 17:09:28 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:28 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358" returned: 0 in 0.593s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:28 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358 Apr 20 17:09:28 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:28 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9" returned: 0 in 0.518s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.254s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Creating offline snapshot 126a106b-913a-42eb-8015-9fbaa93ab3a9 of volume 0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd58af20-bb2f-45de-8da6-048f2d3668d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee013b1-af74-4799-91a9-66d975bccfa9', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afa2adf-cc08-46fc-85de-f7eb62e6c345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7616f67b-1a29-4cc0-9703-8f03a1f37431]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:28 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Volume volume-9ee013b1-af74-4799-91a9-66d975bccfa9 (9ee013b1-af74-4799-91a9-66d975bccfa9): created successfully Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afa2adf-cc08-46fc-85de-f7eb62e6c345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Flow 'volume_create_manager' (7feb6663-66eb-4fed-9bc0-6e48cbfeeb6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-53652238-0239-4c86-b1d7-96be8f41d6d1 tempest-CinderUnicodeTest-2065568543 None] Created volume successfully. Apr 20 17:09:28 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa Apr 20 17:09:28 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:28 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d.951652bf-0276-4e85-ab28-77d44aa72358" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-951652bf-0276-4e85-ab28-77d44aa72358" released by "_delete_snapshot" :: held 2.313s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-538d92b5-9c60-47e8-8506-94a955e64b0d" released by "delete_snapshot" :: held 2.324s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created reservations ['59f25dd8-87ed-4caa-af52-6e954b6b04c7', 'ac4bdf58-b350-4906-b6e9-0ecefd7e6067', '44b27c24-2474-4232-9a0e-69b7ee60c793', '2f2747c7-ce75-4d5c-9ce2-4d2f8c03935c'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Delete snapshot completed successfully. Apr 20 17:09:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0a1b2481-34ad-417b-b9f9-f4802e7b23a2 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-951652bf-0276-4e85-ab28-77d44aa72358-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:29 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa" returned: 0 in 0.588s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:29 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 1G Apr 20 17:09:29 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-538d92b5-9c60-47e8-8506-94a955e64b0d-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-538d92b5-9c60-47e8-8506-94a955e64b0d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "cinder-quobyte-538d92b5-9c60-47e8-8506-94a955e64b0d" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-538d92b5-9c60-47e8-8506-94a955e64b0d" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffb809d-24f6-4a66-bff6-bdff0d818f7e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:29 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d Apr 20 17:09:29 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:29 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 1G" returned: 0 in 0.550s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:29 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 Apr 20 17:09:29 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:30 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:30 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:30 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d" returned: 0 in 0.567s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:30 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d Apr 20 17:09:30 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:30 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9" returned: 0 in 0.501s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:30 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 is being set with open permissions: ugo+rw Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:30 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.484s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:30 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 Apr 20 17:09:30 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:30 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-538d92b5-9c60-47e8-8506-94a955e64b0d" returned: 0 in 0.490s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-quobyte-538d92b5-9c60-47e8-8506-94a955e64b0d" released by "delete_volume" :: held 1.098s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Created reservations ['f50ef39c-0016-4710-a7e7-a08f8d30e62f', 'f74d8a4f-fc54-4b92-878c-dbcbace7bd5c', 'a2cb71be-0b51-4a4c-b270-41a936f52495', '71adbb83-3fb9-4d08-a801-1b540cc63996'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:30 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:30 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:30 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9" returned: 0 in 0.490s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:30 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.info Apr 20 17:09:31 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:31 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.info" returned: 0 in 0.453s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:31 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.info is being set with open permissions: ugo+rw Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:31 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Deleted volume successfully. Apr 20 17:09:31 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.info Apr 20 17:09:31 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46fe1307-faba-4f46-8080-d42e707f4429 tempest-CreateVolumesFromSnapshotTest-854420740 None] Lock "cinder-538d92b5-9c60-47e8-8506-94a955e64b0d-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:31 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.info" returned: 0 in 0.450s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.108s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.610s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Creating offline snapshot 13a624c7-3911-4ccb-8165-6f208237f18a of volume 9ee013b1-af74-4799-91a9-66d975bccfa9 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[235ad71f-eb17-4b1f-a1ee-0f2df1e85806]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3fe34d52-e968-4762-b7af-dae7b72815b9 tempest-VolumesDeleteCascade-1406849053 None] Create snapshot completed successfully Apr 20 17:09:31 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 Apr 20 17:09:32 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:32 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9" returned: 0 in 0.569s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:32 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a 1G Apr 20 17:09:32 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:33 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a 1G" returned: 0 in 0.609s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee013b1-af74-4799-91a9-66d975bccfa9 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:33 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee013b1-af74-4799-91a9-66d975bccfa9 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a Apr 20 17:09:33 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:33 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee013b1-af74-4799-91a9-66d975bccfa9 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:33 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a is being set with open permissions: ugo+rw Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:33 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a Apr 20 17:09:33 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (4e8ca46b-3c96-4b52-871c-48272137ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156b31fe-a8bf-4c2b-8917-283a35d33d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156b31fe-a8bf-4c2b-8917-283a35d33d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767114234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e753178-e823-46ea-ac11-003efbdd7df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:34Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c496406-0077-4272-84d6-95b1fa43f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c496406-0077-4272-84d6-95b1fa43f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857077b3-ed1d-4303-b5f5-1aff86b2cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857077b3-ed1d-4303-b5f5-1aff86b2cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e753178-e823-46ea-ac11-003efbdd7df4', 'volume_name': 'volume-7e753178-e823-46ea-ac11-003efbdd7df4', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc27549-7799-4d66-8da7-04fb314d5109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc27549-7799-4d66-8da7-04fb314d5109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102b4be5-9d5b-48ff-bf6c-a50b35a1a5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:34 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume 7e753178-e823-46ea-ac11-003efbdd7df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e753178-e823-46ea-ac11-003efbdd7df4', 'volume_size': 1} Apr 20 17:09:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:34 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a" returned: 0 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:34 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.info Apr 20 17:09:34 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:34 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.info" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:34 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.info is being set with open permissions: ugo+rw Apr 20 17:09:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:34 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.info Apr 20 17:09:34 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:35 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.info" returned: 0 in 0.431s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.220s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Creating offline snapshot 939d8313-a562-477d-b5b0-f0d5ba15b74a of volume 0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffad834-e830-4a39-aa55-5e4a1e06a697]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:35 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1f374d5e-2e1c-400b-bc81-f39fe4cfbfa5 tempest-CinderUnicodeTest-2065568543 None] Create snapshot completed successfully Apr 20 17:09:35 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 Apr 20 17:09:35 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "cinder-13a624c7-3911-4ccb-8165-6f208237f18a-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-13a624c7-3911-4ccb-8165-6f208237f18a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "cinder-quobyte-9ee013b1-af74-4799-91a9-66d975bccfa9" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-quobyte-9ee013b1-af74-4799-91a9-66d975bccfa9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "cinder-quobyte-13a624c7-3911-4ccb-8165-6f208237f18a" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-quobyte-13a624c7-3911-4ccb-8165-6f208237f18a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Deleting offline snapshot 13a624c7-3911-4ccb-8165-6f208237f18a of volume 9ee013b1-af74-4799-91a9-66d975bccfa9 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] snapshot_file for this snap is: volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[daad0a73-3900-4619-ac76-18dd21f12785]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Flow 'volume_create_manager' (9cfcbbbd-749d-423c-b8a7-1c36a990bc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec22523-4968-4f25-940a-e0d90355af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec22523-4968-4f25-940a-e0d90355af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1875368161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92d5db9fd8149f18ae914633ca5a8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:36Z,use_quota=True,user_id='8aab407066754b8f89876abc99554cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d63c56-a956-454f-a86c-159e5cbb3c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d63c56-a956-454f-a86c-159e5cbb3c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900db499-1c3c-4fa9-bbf3-d7dc5cdf9e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:35 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a Apr 20 17:09:35 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900db499-1c3c-4fa9-bbf3-d7dc5cdf9e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e', 'volume_name': 'volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80836ccf-e8d1-421b-8654-347e0497e1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80836ccf-e8d1-421b-8654-347e0497e1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43541044-bae3-4ce4-ad36-e308d1afb80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:35 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Volume ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e', 'volume_size': 1} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:35 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9" returned: 0 in 0.594s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e23e75a-924a-4b08-bcfe-a658a3306daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:35 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a 1G Apr 20 17:09:35 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:36 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a" returned: 0 in 0.493s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ee013b1-af74-4799-91a9-66d975bccfa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f1eee-5259-4a13-9b11-45dd2e4e30f5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:36 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 Apr 20 17:09:36 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:36 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a 1G" returned: 0 in 0.494s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:36 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a Apr 20 17:09:36 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:36 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9" returned: 0 in 0.468s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:36 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a Apr 20 17:09:36 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:36 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a" returned: 0 in 0.436s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:36 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a is being set with open permissions: ugo+rw Apr 20 17:09:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:36 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a Apr 20 17:09:36 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:37 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a" returned: 0 in 0.400s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:37 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a" returned: 0 in 0.452s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:37 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a Apr 20 17:09:37 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.048s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767114234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e753178-e823-46ea-ac11-003efbdd7df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:34Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Creating volume 7e753178-e823-46ea-ac11-003efbdd7df4 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:37 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:37 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 1073741824 Apr 20 17:09:37 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:37 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-fc3c0d56-aa17-4e66-842c-59465870b115 tempest-VolumesDeleteCascade-1406849053 None] Create snapshot completed successfully Apr 20 17:09:37 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9.13a624c7-3911-4ccb-8165-6f208237f18a" returned: 0 in 0.405s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-quobyte-13a624c7-3911-4ccb-8165-6f208237f18a" released by "_delete_snapshot" :: held 1.882s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-quobyte-9ee013b1-af74-4799-91a9-66d975bccfa9" released by "delete_snapshot" :: held 1.900s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Created reservations ['7e5219b3-7b4a-46ba-9371-ecba3d5d6e31', 'd33cf20b-65ab-4eb4-9377-0ab50e195515', '697d0625-da87-4019-a7e0-57d64d5476f3', '96599c7d-82d6-490e-a439-cf2e4566d68d'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:37 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Delete snapshot completed successfully. Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c217cf4d-bbe2-4a53-bdac-4df72f2c3cad tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-13a624c7-3911-4ccb-8165-6f208237f18a-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:37 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 1073741824" returned: 0 in 0.480s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:37 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 Apr 20 17:09:37 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "cinder-9ee013b1-af74-4799-91a9-66d975bccfa9-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-9ee013b1-af74-4799-91a9-66d975bccfa9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "cinder-quobyte-9ee013b1-af74-4799-91a9-66d975bccfa9" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-quobyte-9ee013b1-af74-4799-91a9-66d975bccfa9" acquired by "delete_volume" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4f0ea5-8d52-4d40-bf1b-6357bc1d7bd2]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:37 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 Apr 20 17:09:37 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:37 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4" returned: 0 in 0.415s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1875368161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92d5db9fd8149f18ae914633ca5a8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:36Z,use_quota=True,user_id='8aab407066754b8f89876abc99554cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Creating volume ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:38 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-0e23e75a-924a-4b08-bcfe-a658a3306daa-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102b4be5-9d5b-48ff-bf6c-a50b35a1a5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e753178-e823-46ea-ac11-003efbdd7df4', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ee9e5b-6803-4d36-aafc-b18eea8de0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume volume-7e753178-e823-46ea-ac11-003efbdd7df4 (7e753178-e823-46ea-ac11-003efbdd7df4): created successfully Apr 20 17:09:38 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e 1073741824 Apr 20 17:09:38 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ee9e5b-6803-4d36-aafc-b18eea8de0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (4e8ca46b-3c96-4b52-871c-48272137ae38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-0e23e75a-924a-4b08-bcfe-a658a3306daa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-63969a42-b869-4bb8-8b58-a96a447d142d tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created volume successfully. Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Performing cascade delete. {{(pid=82240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-126a106b-913a-42eb-8015-9fbaa93ab3a9-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-126a106b-913a-42eb-8015-9fbaa93ab3a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-126a106b-913a-42eb-8015-9fbaa93ab3a9" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-126a106b-913a-42eb-8015-9fbaa93ab3a9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Deleting offline snapshot 126a106b-913a-42eb-8015-9fbaa93ab3a9 of volume 0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] snapshot_file for this snap is: volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6874125b-95d8-45a7-bdef-f542421f2c6c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:38 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 Apr 20 17:09:38 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:38 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9" returned: 0 in 0.523s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:38 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9 Apr 20 17:09:38 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (78bc1cf6-05c5-46bb-9838-4d178628d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa87363-ed72-45d9-9dd5-492a85a9c0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa87363-ed72-45d9-9dd5-492a85a9c0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889699777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff3f3dc-f2be-462c-a674-31a667cf3d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:38Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451f9584-7679-4dd1-aae0-bb001b51426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451f9584-7679-4dd1-aae0-bb001b51426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc66c06-7aec-4997-a2c2-1d089bf22032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc66c06-7aec-4997-a2c2-1d089bf22032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff3f3dc-f2be-462c-a674-31a667cf3d6c', 'volume_name': 'volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9fd6c-8522-4f52-8cd8-ea7d3979278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9fd6c-8522-4f52-8cd8-ea7d3979278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67527ab0-759d-41f5-bf6c-063948794dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume eff3f3dc-f2be-462c-a674-31a667cf3d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c', 'volume_size': 1} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:38 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e 1073741824" returned: 0 in 0.596s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:38 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e Apr 20 17:09:38 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:38 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (7aadb65b-9985-442d-bf10-3587d74a0033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48802ffb-6e0d-49f8-b292-386004b0c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9" returned: 0 in 0.612s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e23e75a-924a-4b08-bcfe-a658a3306daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec354b5d-c64f-4d72-acb1-6d5c9cc20e1a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48802ffb-6e0d-49f8-b292-386004b0c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387095482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e144dfa-90c6-41bd-951b-f958d62edfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:39Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20519e12-e32d-464e-be3b-ed34e847bf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20519e12-e32d-464e-be3b-ed34e847bf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da38a63-9751-4527-84ae-ecaf4bca270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da38a63-9751-4527-84ae-ecaf4bca270c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e144dfa-90c6-41bd-951b-f958d62edfb3', 'volume_name': 'volume-2e144dfa-90c6-41bd-951b-f958d62edfb3', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc37be4-10f4-4d4a-83bb-324f0c99ca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc37be4-10f4-4d4a-83bb-324f0c99ca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11152c50-3570-48f0-8335-ad27d444369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume 2e144dfa-90c6-41bd-951b-f958d62edfb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e144dfa-90c6-41bd-951b-f958d62edfb3', 'volume_size': 1} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:38 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa Apr 20 17:09:38 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (3a07f558-1ca8-42d1-bb5a-b5743e880a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6879a920-da67-4c9b-825d-7a0f2c529466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6879a920-da67-4c9b-825d-7a0f2c529466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089751495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb4dc69-99e1-4b08-a811-a1231a37cc8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:39Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca8f61d-4322-4b1f-ae63-23df5eb9fb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca8f61d-4322-4b1f-ae63-23df5eb9fb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d47e888-7ef1-4439-ae66-dee111dffdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d47e888-7ef1-4439-ae66-dee111dffdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb4dc69-99e1-4b08-a811-a1231a37cc8f', 'volume_name': 'volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0f5115-16d9-4265-8179-0c7f4e1d133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0f5115-16d9-4265-8179-0c7f4e1d133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1279147-a713-4582-b139-393c8a05b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume fdb4dc69-99e1-4b08-a811-a1231a37cc8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f', 'volume_size': 1} Apr 20 17:09:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:39 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9ee013b1-af74-4799-91a9-66d975bccfa9" returned: 0 in 0.823s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-quobyte-9ee013b1-af74-4799-91a9-66d975bccfa9" released by "delete_volume" :: held 1.382s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Created reservations ['265d8780-3b06-48bf-adfb-a802308a2532', '6910947b-cc4e-428e-9cd9-41d8a6be744a', 'd3d69fb2-b654-4337-8261-6e56d397d72e', '0e4b8d51-e61b-4d5b-8e91-a0e5523207b5'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (59c6f9c3-3944-4150-ba38-bdcee4102896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea3baaa-2773-42c3-8d1a-4ad098dc290c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea3baaa-2773-42c3-8d1a-4ad098dc290c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752321629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54727e65-cff9-4059-827e-682121e0ceab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:39Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199c0b88-befe-46b4-b0a6-dc80a0873b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199c0b88-befe-46b4-b0a6-dc80a0873b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5a6fe2-27b5-43d4-8786-b741f2158b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5a6fe2-27b5-43d4-8786-b741f2158b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54727e65-cff9-4059-827e-682121e0ceab', 'volume_name': 'volume-54727e65-cff9-4059-827e-682121e0ceab', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21d1f61-7483-4783-9480-6f2e822a0f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21d1f61-7483-4783-9480-6f2e822a0f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff9cec6-fa6d-42ab-8b29-5317c734e096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume 54727e65-cff9-4059-827e-682121e0ceab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54727e65-cff9-4059-827e-682121e0ceab', 'volume_size': 1} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:39 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" returned: 0 in 0.639s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889699777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff3f3dc-f2be-462c-a674-31a667cf3d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:38Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Creating volume eff3f3dc-f2be-462c-a674-31a667cf3d6c {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:39 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43541044-bae3-4ce4-ad36-e308d1afb80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad54a8b-8d59-4b1e-8a63-2562a726a7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Volume volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e (ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e): created successfully Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad54a8b-8d59-4b1e-8a63-2562a726a7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c 1073741824 Apr 20 17:09:39 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Flow 'volume_create_manager' (9cfcbbbd-749d-423c-b8a7-1c36a990bc06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:39 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c3688345-8b92-4c85-9d23-5767e54b7264 tempest-SnapshotMetadataTestJSON-1359007908 None] Created volume successfully. Apr 20 17:09:39 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:39 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (12bb0eea-a388-4e84-ade9-1d813463e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db2ed4e-4f64-47bf-8ce2-183fe7740286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db2ed4e-4f64-47bf-8ce2-183fe7740286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-333739932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c86da5a-6bc0-4ebe-b2b1-12432c87b26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:39Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082a2cbf-fa67-41d7-8f42-3440d8412ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082a2cbf-fa67-41d7-8f42-3440d8412ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6cd544-8f36-43f1-9a1d-d3dbce771fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6cd544-8f36-43f1-9a1d-d3dbce771fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c86da5a-6bc0-4ebe-b2b1-12432c87b26c', 'volume_name': 'volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1a096f-0465-49cf-9997-842870cc905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1a096f-0465-49cf-9997-842870cc905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078436ef-3322-4bb4-9f5b-ee2ecb3e2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:39 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume 6c86da5a-6bc0-4ebe-b2b1-12432c87b26c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c', 'volume_size': 1} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:39 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa" returned: 0 in 0.683s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c1032-e634-48e8-8acd-d1606e478c6b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:39 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a Apr 20 17:09:39 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:39 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.472s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:39 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Deleted volume successfully. Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ab4f33e6-56d3-4de2-9e14-eea1f4bfd1a8 tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-9ee013b1-af74-4799-91a9-66d975bccfa9-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "cinder-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "cinder-quobyte-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:39 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c 1073741824" returned: 0 in 0.672s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-quobyte-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0" acquired by "delete_volume" :: waited 0.025s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6561e78e-2b93-410f-bd3f-dff486b1b027]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:40 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c Apr 20 17:09:40 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:40 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 Apr 20 17:09:40 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:40 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a" returned: 0 in 0.600s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e23e75a-924a-4b08-bcfe-a658a3306daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c7e3d-2c1b-4278-ba87-bb5e24dceca9]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:40 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 Apr 20 17:09:40 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:40 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0" returned: 0 in 0.508s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:40 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c" returned: 0 in 0.488s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.660s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:40 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0 Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387095482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e144dfa-90c6-41bd-951b-f958d62edfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:39Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:40 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Creating volume 2e144dfa-90c6-41bd-951b-f958d62edfb3 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:40 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67527ab0-759d-41f5-bf6c-063948794dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f32b81-00de-42d8-888b-ec6dd1f0c6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:40 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 1073741824 Apr 20 17:09:40 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:40 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c (eff3f3dc-f2be-462c-a674-31a667cf3d6c): created successfully Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f32b81-00de-42d8-888b-ec6dd1f0c6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (78bc1cf6-05c5-46bb-9838-4d178628d11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:40 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f52164f8-73e2-4fcc-8320-98abaa25fac1 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created volume successfully. Apr 20 17:09:40 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9" returned: 0 in 0.502s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e23e75a-924a-4b08-bcfe-a658a3306daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[916bb0a0-fe55-4fd0-b8ce-08b4520c9fcd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:40 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa Apr 20 17:09:40 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:40 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0" returned: 0 in 0.405s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-quobyte-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0" released by "delete_volume" :: held 0.952s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Created reservations ['87887575-7f68-4f8b-84bc-1a3f579747a1', '738bd1da-1d87-4e1f-b56f-34b4d086418b', '16e546e3-4a34-49aa-8ecb-12721fe3c3c2', 'c149a23f-cbaa-4bcb-8885-9d1f2f21a111'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:41 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:41 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:41 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 1073741824" returned: 0 in 0.529s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:41 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 Apr 20 17:09:41 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:41 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa" returned: 0 in 0.541s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:41 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 Apr 20 17:09:41 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:41 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.518s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:41 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Deleted volume successfully. Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-33bcd997-65c8-4d39-a145-101051aa7b3c tempest-CinderUnicodeTest-2065568543 None] Lock "cinder-505f63ce-22a8-468e-8dd3-13e9eaf8b3f0-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:41 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3" returned: 0 in 0.506s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089751495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb4dc69-99e1-4b08-a811-a1231a37cc8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:39Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Creating volume fdb4dc69-99e1-4b08-a811-a1231a37cc8f {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:41 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11152c50-3570-48f0-8335-ad27d444369b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e144dfa-90c6-41bd-951b-f958d62edfb3', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3690ac2a-3f35-4250-8ae0-87c5e04da919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:41 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f 1073741824 Apr 20 17:09:41 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:41 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 (2e144dfa-90c6-41bd-951b-f958d62edfb3): created successfully Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3690ac2a-3f35-4250-8ae0-87c5e04da919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (7aadb65b-9985-442d-bf10-3587d74a0033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:41 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d310286e-9312-46f2-addb-0061c80076ff tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created volume successfully. Apr 20 17:09:41 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9" returned: 0 in 0.566s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:41 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9 Apr 20 17:09:41 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:42 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f 1073741824" returned: 0 in 0.567s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:42 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f Apr 20 17:09:42 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:42 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.126a106b-913a-42eb-8015-9fbaa93ab3a9" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a -F qcow2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:42 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a -F qcow2 Apr 20 17:09:42 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:42 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.477s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752321629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54727e65-cff9-4059-827e-682121e0ceab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:39Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Creating volume 54727e65-cff9-4059-827e-682121e0ceab {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:42 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1279147-a713-4582-b139-393c8a05b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6567b545-a6ae-47f7-9c76-0d42f835227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:42 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab 1073741824 Apr 20 17:09:42 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:42 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f (fdb4dc69-99e1-4b08-a811-a1231a37cc8f): created successfully Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6567b545-a6ae-47f7-9c76-0d42f835227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (3a07f558-1ca8-42d1-bb5a-b5743e880a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:42 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-2239ff36-3866-4ccf-929c-86e68963fa56 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created volume successfully. Apr 20 17:09:42 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e23e75a-924a-4b08-bcfe-a658a3306daa /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a -F qcow2" returned: 0 in 0.499s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-126a106b-913a-42eb-8015-9fbaa93ab3a9" released by "_delete_snapshot" :: held 4.658s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" released by "delete_snapshot" :: held 4.670s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Created reservations ['20959341-6486-4a09-a739-a05b46e68b71', '2ba0d712-60a2-49b1-ab61-f1ccdafbcc91', 'c8b52c25-7aae-4aab-9333-4b3f46aacdae', '1be4a97e-17f8-4eeb-9a33-31033d3b3b29'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:42 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Delete snapshot completed successfully. Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-126a106b-913a-42eb-8015-9fbaa93ab3a9-delete_snapshot" released by "delete_snapshot" :: held 4.774s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-939d8313-a562-477d-b5b0-f0d5ba15b74a-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-939d8313-a562-477d-b5b0-f0d5ba15b74a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-939d8313-a562-477d-b5b0-f0d5ba15b74a" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-939d8313-a562-477d-b5b0-f0d5ba15b74a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Deleting offline snapshot 939d8313-a562-477d-b5b0-f0d5ba15b74a of volume 0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] snapshot_file for this snap is: volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dd0e22-4765-4999-9d36-7354f16da0b3]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:43 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a Apr 20 17:09:43 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:43 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab 1073741824" returned: 0 in 0.587s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:43 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab Apr 20 17:09:43 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:43 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a" returned: 0 in 0.546s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e23e75a-924a-4b08-bcfe-a658a3306daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d335aa-82f0-495e-a65f-c0464dc5e1bf]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:43 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa Apr 20 17:09:43 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:43 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab" returned: 0 in 0.452s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.336s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-333739932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c86da5a-6bc0-4ebe-b2b1-12432c87b26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4712329a8f4e03823cc753e7abc60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:39Z,use_quota=True,user_id='ee8c5d46665d477999d3ca81493d6ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Creating volume 6c86da5a-6bc0-4ebe-b2b1-12432c87b26c {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:43 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:43 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c 1073741824 Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff9cec6-fa6d-42ab-8b29-5317c734e096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54727e65-cff9-4059-827e-682121e0ceab', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:43 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dd73b5-7903-4b9b-b580-7a61d060cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:43 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume volume-54727e65-cff9-4059-827e-682121e0ceab (54727e65-cff9-4059-827e-682121e0ceab): created successfully Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dd73b5-7903-4b9b-b580-7a61d060cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (59c6f9c3-3944-4150-ba38-bdcee4102896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-367fdf46-f7de-4d10-8162-879759c10cf4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created volume successfully. Apr 20 17:09:43 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa" returned: 0 in 0.498s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:44 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a Apr 20 17:09:44 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:44 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c 1073741824" returned: 0 in 0.476s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:44 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c Apr 20 17:09:44 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:44 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a" returned: 0 in 0.518s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:44 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a Apr 20 17:09:44 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:44 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c" returned: 0 in 0.440s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.737s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078436ef-3322-4bb4-9f5b-ee2ecb3e2029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a5593a-fdba-414c-a132-e582bc56b9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:44 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Volume volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c (6c86da5a-6bc0-4ebe-b2b1-12432c87b26c): created successfully Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a5593a-fdba-414c-a132-e582bc56b9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Flow 'volume_create_manager' (12bb0eea-a388-4e84-ade9-1d813463e131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Creating offline snapshot 23ed7744-a324-4713-9494-b97eed4385fe of volume ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:09:44 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-141d146c-7308-4cdf-901e-dbb5c3852272 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created volume successfully. Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddb668a-0b64-4058-8e13-a0fa97c3c271]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:44 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e Apr 20 17:09:44 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-quobyte-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2b416c-5bdd-4c2d-9f85-c931ea73ce4d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:45 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c Apr 20 17:09:45 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:45 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa.939d8313-a562-477d-b5b0-f0d5ba15b74a" returned: 0 in 0.519s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-939d8313-a562-477d-b5b0-f0d5ba15b74a" released by "_delete_snapshot" :: held 2.134s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" released by "delete_snapshot" :: held 2.145s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Created reservations ['ac6de605-7256-4620-b087-035d4e9c9369', '7fbf7b25-e079-444f-b091-aa2b9ce7d02b', 'fa7806b8-90f6-4b91-acc3-0e238149f4f1', '2712ecc4-90d9-4519-9fac-e65968670703'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:45 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Delete snapshot completed successfully. Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-939d8313-a562-477d-b5b0-f0d5ba15b74a-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Snapshots deleted, issuing volume delete {{(pid=82240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e80251-9c6e-4a8e-808b-150b97177a96]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:45 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa Apr 20 17:09:45 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:45 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" returned: 0 in 0.566s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:45 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe 1G Apr 20 17:09:45 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:45 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c" returned: 0 in 0.624s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:45 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c Apr 20 17:09:45 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:45 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa" returned: 0 in 0.530s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:45 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa Apr 20 17:09:45 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:45 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe 1G" returned: 0 in 0.497s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:45 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe Apr 20 17:09:45 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:46 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c" released by "delete_volume" :: held 1.145s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created reservations ['7128c525-a3ff-497b-a2fa-7be6745257af', '56d83f89-cd17-4060-992c-3ac41e0c54d6', 'ff91de46-4bc0-4b11-bb2c-b79781267b87', 'b2d3f074-0481-4c13-bb5b-fb88f33721f0'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:46 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0e23e75a-924a-4b08-bcfe-a658a3306daa" returned: 0 in 0.461s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-0e23e75a-924a-4b08-bcfe-a658a3306daa" released by "delete_volume" :: held 1.090s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:46 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:46 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Created reservations ['7580af52-5a5a-49de-afbc-7aef59eb8bd3', '3bca4080-cddd-423e-99a2-21fb8c0ce4cc', '51fe8050-144b-433e-81a7-257562ed8982', '8df957ed-b21a-4f3c-9e5c-281b597d73f6'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:46 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:46 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:46 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe" returned: 0 in 0.599s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:46 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe is being set with open permissions: ugo+rw Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:46 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe Apr 20 17:09:46 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Flow 'volume_create_manager' (a7d8ffa6-a3f3-4f88-893a-9cb7d8db8117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:46 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ade8d7-7b85-43d4-bc17-b2be2feef3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ade8d7-7b85-43d4-bc17-b2be2feef3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1091905022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db13c1a-a554-44a2-87b3-833795b5c05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e63afb2f8dd4d44ab8caa9255055d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:47Z,use_quota=True,user_id='c55064da57674c46a6a0110e42a5406a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:47 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214cdc12-f69e-43f9-816e-56b08de27020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214cdc12-f69e-43f9-816e-56b08de27020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:47 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386caf8c-d102-4859-a796-567d81b8e0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386caf8c-d102-4859-a796-567d81b8e0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db13c1a-a554-44a2-87b3-833795b5c05f', 'volume_name': 'volume-8db13c1a-a554-44a2-87b3-833795b5c05f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe96773-df52-47cd-952c-d4217e6b532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe96773-df52-47cd-952c-d4217e6b532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cf6628-ab70-44b7-9c12-d7b2310b3992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:47 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Volume 8db13c1a-a554-44a2-87b3-833795b5c05f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db13c1a-a554-44a2-87b3-833795b5c05f', 'volume_size': 1} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe" returned: 0 in 0.576s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.822s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:47 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Deleted volume successfully. Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0c1fe05b-b77d-4f2c-bf46-f0035fe1f3f4 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-6c86da5a-6bc0-4ebe-b2b1-12432c87b26c-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:47 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.info Apr 20 17:09:47 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-54727e65-cff9-4059-827e-682121e0ceab-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-54727e65-cff9-4059-827e-682121e0ceab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:47 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-quobyte-54727e65-cff9-4059-827e-682121e0ceab" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.804s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-54727e65-cff9-4059-827e-682121e0ceab" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:47 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Deleted volume successfully. Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d45191-6965-439c-b81d-59f3fc68aa6e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dc80736e-fc60-4002-9211-c0eef50420fc tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-0e23e75a-924a-4b08-bcfe-a658a3306daa-delete_volume" released by "delete_volume" :: held 9.154s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:47 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab Apr 20 17:09:47 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:47 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.info" returned: 0 in 0.560s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:47 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.info is being set with open permissions: ugo+rw Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:47 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.info Apr 20 17:09:47 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:47 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab" returned: 0 in 0.503s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:47 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab Apr 20 17:09:47 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:48 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-54727e65-cff9-4059-827e-682121e0ceab" returned: 0 in 0.423s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-54727e65-cff9-4059-827e-682121e0ceab" released by "delete_volume" :: held 0.952s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:48 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.info" returned: 0 in 0.511s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.401s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1091905022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db13c1a-a554-44a2-87b3-833795b5c05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e63afb2f8dd4d44ab8caa9255055d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:47Z,use_quota=True,user_id='c55064da57674c46a6a0110e42a5406a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Creating volume 8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:48 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:48 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f 1073741824 Apr 20 17:09:48 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:48 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7c15adfc-ba52-4155-bb36-cb33c63eb058 tempest-SnapshotMetadataTestJSON-1359007908 None] Create snapshot completed successfully Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created reservations ['3b37636c-3969-4f74-9af9-55f4070725a2', '8364f6a6-d8e5-429c-b2a6-7daafa5c24e8', 'a0eb9d2b-00f7-4c7f-928a-9600cbc8810b', 'c63e43cf-88f2-457d-8d81-2930ea38c10e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:48 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:48 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:48 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f 1073741824" returned: 0 in 0.538s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:48 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f Apr 20 17:09:48 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:48 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:48 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Deleted volume successfully. Apr 20 17:09:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-96202fd1-f9a5-4253-b0d6-4cdb654b5f11 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-54727e65-cff9-4059-827e-682121e0ceab-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:49 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f" returned: 0 in 0.436s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cf6628-ab70-44b7-9c12-d7b2310b3992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db13c1a-a554-44a2-87b3-833795b5c05f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc515eb-7422-4c69-8827-633f907e9897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:49 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Volume volume-8db13c1a-a554-44a2-87b3-833795b5c05f (8db13c1a-a554-44a2-87b3-833795b5c05f): created successfully Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc515eb-7422-4c69-8827-633f907e9897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Flow 'volume_create_manager' (a7d8ffa6-a3f3-4f88-893a-9cb7d8db8117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9858ef4c-72e3-404f-9527-1139b2e4be62 tempest-VolumesDeleteCascade-1406849053 None] Created volume successfully. Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-fdb4dc69-99e1-4b08-a811-a1231a37cc8f-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-fdb4dc69-99e1-4b08-a811-a1231a37cc8f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-quobyte-fdb4dc69-99e1-4b08-a811-a1231a37cc8f" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-fdb4dc69-99e1-4b08-a811-a1231a37cc8f" acquired by "delete_volume" :: waited 0.022s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbc0c5c-18cc-4b12-afef-106302098c19]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:49 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f Apr 20 17:09:49 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "cinder-23ed7744-a324-4713-9494-b97eed4385fe-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-23ed7744-a324-4713-9494-b97eed4385fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "cinder-quobyte-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-quobyte-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "cinder-quobyte-23ed7744-a324-4713-9494-b97eed4385fe" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-quobyte-23ed7744-a324-4713-9494-b97eed4385fe" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Deleting offline snapshot 23ed7744-a324-4713-9494-b97eed4385fe of volume ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] snapshot_file for this snap is: volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d98bb1-2602-4643-9146-db9d1d41cfc0]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:50 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe Apr 20 17:09:50 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:50 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f" returned: 0 in 0.690s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:50 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f Apr 20 17:09:50 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Creating offline snapshot 158d2c8c-2463-4d86-b288-b6eee4a5743a of volume 8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dab018-6c91-4b86-bd43-c077a5666940]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:50 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f Apr 20 17:09:50 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:50 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fdb4dc69-99e1-4b08-a811-a1231a37cc8f" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-fdb4dc69-99e1-4b08-a811-a1231a37cc8f" released by "delete_volume" :: held 1.199s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created reservations ['2f7ea26d-d5c6-4442-a636-f659af5fe40d', '676c7ab3-713f-455c-9aaa-106d37474ed4', '91af02c4-d0fd-4f5d-b09b-fe1d4c8ebce6', '84a6bf18-9755-4168-869f-3512fa93003b'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:50 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe" returned: 0 in 0.736s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a4ad93-9d78-4fe0-84c6-b425f5affd91]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:50 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:50 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:50 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e Apr 20 17:09:50 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:50 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f" returned: 0 in 0.596s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:50 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a 1G Apr 20 17:09:50 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:51 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.470s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:51 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Deleted volume successfully. Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-00658a7e-bb88-4518-8a8f-4741cf4d2316 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-fdb4dc69-99e1-4b08-a811-a1231a37cc8f-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:51 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" returned: 0 in 0.553s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:51 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe Apr 20 17:09:51 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:51 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a 1G" returned: 0 in 0.632s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db13c1a-a554-44a2-87b3-833795b5c05f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:51 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db13c1a-a554-44a2-87b3-833795b5c05f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a Apr 20 17:09:51 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-2e144dfa-90c6-41bd-951b-f958d62edfb3-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-2e144dfa-90c6-41bd-951b-f958d62edfb3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-quobyte-2e144dfa-90c6-41bd-951b-f958d62edfb3" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-2e144dfa-90c6-41bd-951b-f958d62edfb3" acquired by "delete_volume" :: waited 0.017s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[959dec28-cf66-4bb0-8f38-3ff7fd2899ca]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:51 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 Apr 20 17:09:51 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:51 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe" returned: 0 in 0.538s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:51 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe Apr 20 17:09:51 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:52 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db13c1a-a554-44a2-87b3-833795b5c05f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:52 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a is being set with open permissions: ugo+rw Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:52 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a Apr 20 17:09:52 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:52 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3" returned: 0 in 0.562s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:52 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3 Apr 20 17:09:52 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:52 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e.23ed7744-a324-4713-9494-b97eed4385fe" returned: 0 in 0.477s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-quobyte-23ed7744-a324-4713-9494-b97eed4385fe" released by "_delete_snapshot" :: held 2.370s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-quobyte-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" released by "delete_snapshot" :: held 2.394s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Created reservations ['dc408831-63b6-4dac-a2c5-c6e0a641f34f', '1686beeb-e6a6-4682-a9f2-4a24be84f60a', '35a6ca5c-e6a6-4f75-a1e1-24c5ac71b701', '0db2958f-bd67-46e8-8c24-9798772a5cf0'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:52 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Delete snapshot completed successfully. Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5da5e0ec-4c3e-4146-aad0-7206ae23a8fc tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-23ed7744-a324-4713-9494-b97eed4385fe-delete_snapshot" released by "delete_snapshot" :: held 2.489s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:52 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a" returned: 0 in 0.520s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:52 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.info Apr 20 17:09:52 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:52 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2e144dfa-90c6-41bd-951b-f958d62edfb3" returned: 0 in 0.474s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-2e144dfa-90c6-41bd-951b-f958d62edfb3" released by "delete_volume" :: held 1.059s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created reservations ['650de91e-675e-453a-8bc2-f2c409fb0ac8', '850e486e-d30e-42ef-9318-5f76318280bc', 'd813922c-27fe-413b-9393-725fa0fdaa82', 'cd0e79a6-8149-4f18-a15f-902ee855365c'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:52 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:52 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:53 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.info" returned: 0 in 0.499s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:53 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.info is being set with open permissions: ugo+rw Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:53 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.info Apr 20 17:09:53 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "cinder-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "cinder-quobyte-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-quobyte-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8d8eb3-dce7-419d-a287-9170a80998d8]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:53 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.494s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:53 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Deleted volume successfully. Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71d846d2-b153-4c62-b639-b125107c0486 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-2e144dfa-90c6-41bd-951b-f958d62edfb3-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:53 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e Apr 20 17:09:53 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:53 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.info" returned: 0 in 0.523s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.328s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:53 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a898cf89-b21f-4138-9991-4f08f64713ae tempest-VolumesDeleteCascade-1406849053 None] Create snapshot completed successfully Apr 20 17:09:53 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" returned: 0 in 0.524s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:53 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e Apr 20 17:09:53 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-eff3f3dc-f2be-462c-a674-31a667cf3d6c-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-eff3f3dc-f2be-462c-a674-31a667cf3d6c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-quobyte-eff3f3dc-f2be-462c-a674-31a667cf3d6c" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-eff3f3dc-f2be-462c-a674-31a667cf3d6c" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6037c7d-f871-49af-8d6e-2826465a86fd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:53 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c Apr 20 17:09:53 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:54 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" returned: 0 in 0.454s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-quobyte-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e" released by "delete_volume" :: held 1.011s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Created reservations ['d43c32aa-ad36-4cae-8618-af7b6e89af7f', 'a4ff58d6-7b6e-4c72-b8cf-d71adb655d11', 'e5acf935-9e3e-494e-9e05-c443508fcaac', 'a46da9d1-a88f-40eb-88f3-aef11cb6d5bc'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:54 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:54 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:54 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c" returned: 0 in 0.627s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:54 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c Apr 20 17:09:54 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:54 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.430s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:54 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Deleted volume successfully. Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-80bb3c40-7d4a-4c18-9dbd-2b5feb675194 tempest-SnapshotMetadataTestJSON-1359007908 None] Lock "cinder-ab31c02b-9aa6-4cce-a4c7-9550d6feaa4e-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Flow 'volume_create_manager' (cc9b0f4f-f175-4c23-85db-54f033df603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed7302c-cd1d-484f-8841-be678c68300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed7302c-cd1d-484f-8841-be678c68300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-203701192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1740f61-ec1d-4923-a514-aab0ed713fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e63afb2f8dd4d44ab8caa9255055d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=158d2c8c-2463-4d86-b288-b6eee4a5743a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:09:55Z,use_quota=True,user_id='c55064da57674c46a6a0110e42a5406a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc949f0-828e-4585-8345-e9b239725fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc949f0-828e-4585-8345-e9b239725fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8ee44-7518-492f-8e2a-152621aa355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8ee44-7518-492f-8e2a-152621aa355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1740f61-ec1d-4923-a514-aab0ed713fc9', 'volume_name': 'volume-d1740f61-ec1d-4923-a514-aab0ed713fc9', 'volume_size': 1, 'snapshot_id': '158d2c8c-2463-4d86-b288-b6eee4a5743a'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fb1561-3952-417c-9737-40e6258dbfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fb1561-3952-417c-9737-40e6258dbfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772f3ad6-f59c-4e3f-97da-e738dd3a2b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:55 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Volume d1740f61-ec1d-4923-a514-aab0ed713fc9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1740f61-ec1d-4923-a514-aab0ed713fc9', 'volume_size': 1, 'snapshot_id': '158d2c8c-2463-4d86-b288-b6eee4a5743a'} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-158d2c8c-2463-4d86-b288-b6eee4a5743a-d1740f61-ec1d-4923-a514-aab0ed713fc9" by "_create_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-158d2c8c-2463-4d86-b288-b6eee4a5743a-d1740f61-ec1d-4923-a514-aab0ed713fc9" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Creating volume d1740f61-ec1d-4923-a514-aab0ed713fc9 from snapshot 158d2c8c-2463-4d86-b288-b6eee4a5743a {{(pid=82240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-d1740f61-ec1d-4923-a514-aab0ed713fc9" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-d1740f61-ec1d-4923-a514-aab0ed713fc9" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] snapshot: 158d2c8c-2463-4d86-b288-b6eee4a5743a, volume: d1740f61-ec1d-4923-a514-aab0ed713fc9, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f81342-3047-4c98-9465-d0adea60b419]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:55 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-eff3f3dc-f2be-462c-a674-31a667cf3d6c" returned: 0 in 0.637s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-eff3f3dc-f2be-462c-a674-31a667cf3d6c" released by "delete_volume" :: held 1.292s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created reservations ['e2fa3dd0-6f20-4a86-8afd-6311a685e804', '1653e5ba-d054-4b0a-bbe6-4eacdbcc1b5b', 'c79d9e46-ed27-4651-99c6-754f62c8e9d1', 'bebce6d7-d6bf-4ca1-920c-6b71876efbd3'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:55 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a Apr 20 17:09:55 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:55 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:55 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:55 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.551s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:55 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Deleted volume successfully. Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ba6d16ab-f2f3-44dd-83ad-4b9fd2d8421f tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-eff3f3dc-f2be-462c-a674-31a667cf3d6c-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:55 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a" returned: 0 in 0.812s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8db13c1a-a554-44a2-87b3-833795b5c05f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1742c6-c5f6-4403-8c26-24ef1bcfa169]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:56 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f Apr 20 17:09:56 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-7e753178-e823-46ea-ac11-003efbdd7df4-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-7e753178-e823-46ea-ac11-003efbdd7df4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "cinder-quobyte-7e753178-e823-46ea-ac11-003efbdd7df4" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-7e753178-e823-46ea-ac11-003efbdd7df4" acquired by "delete_volume" :: waited 0.024s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[319b8edd-3ba0-44a6-ad8d-4839b356e06d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:56 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 Apr 20 17:09:56 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:56 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f" returned: 0 in 0.755s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:56 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 Apr 20 17:09:56 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:56 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4" returned: 0 in 0.668s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:56 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4 Apr 20 17:09:56 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:58 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7e753178-e823-46ea-ac11-003efbdd7df4" returned: 0 in 1.557s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-quobyte-7e753178-e823-46ea-ac11-003efbdd7df4" released by "delete_volume" :: held 2.294s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Created reservations ['6e29aaf7-d714-4dba-b53e-ca14d38b99f8', 'a48d0a80-b2f3-4b54-8dcd-3f49fc058d6d', '942666ee-eff9-4ac8-baf6-16c9a0324a07', '161b2dfb-a120-4c75-83ce-dd7c242f66f4'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:09:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:59 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:09:59 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:59 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9" returned: 0 in 2.630s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7decbe-86f9-4668-8696-9aef063df3cb]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:09:59 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f Apr 20 17:09:59 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:09:59 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.605s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:09:59 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Deleted volume successfully. Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fd98c7b7-d057-4883-a350-2fd880c98cb9 tempest-CreateVolumesFromSourceVolumeTest-1718652700 None] Lock "cinder-7e753178-e823-46ea-ac11-003efbdd7df4-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Flow 'volume_create_manager' (942fcc0a-1e7b-459a-a02a-fcd94ebcd465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76bb70c-3a43-42ac-bdf1-e875b4432280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76bb70c-3a43-42ac-bdf1-e875b4432280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-164920484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021b93ac-a572-498c-a2d2-7b4283a9d6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b3aa714dd44ad4a172bfb45ee2abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:00Z,use_quota=True,user_id='4a57d947c6134edcbb3642b05840a48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68f5c0b-84cd-462a-a0a4-ccfbdd8b6323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68f5c0b-84cd-462a-a0a4-ccfbdd8b6323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f0fc24-100f-42f8-bddc-083bdcd28ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f0fc24-100f-42f8-bddc-083bdcd28ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '021b93ac-a572-498c-a2d2-7b4283a9d6c8', 'volume_name': 'volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a532e90-9fc8-4bfd-80d6-1ea20451ac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a532e90-9fc8-4bfd-80d6-1ea20451ac04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31774ec8-e950-4541-a73a-ca909a4deaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:09:59 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Volume 021b93ac-a572-498c-a2d2-7b4283a9d6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8', 'volume_size': 1} Apr 20 17:09:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:00 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f" returned: 0 in 0.854s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:10:00 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Converted 1024.00 MB image at 389.02 MB/s Apr 20 17:10:00 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 is being set with open permissions: ugo+rw Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:00 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 Apr 20 17:10:00 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:00 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9" returned: 0 in 0.575s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-d1740f61-ec1d-4923-a514-aab0ed713fc9" released by "_copy_volume_from_snapshot" :: held 5.707s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-158d2c8c-2463-4d86-b288-b6eee4a5743a-d1740f61-ec1d-4923-a514-aab0ed713fc9" released by "_create_volume_from_snapshot" :: held 5.731s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.739s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-164920484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021b93ac-a572-498c-a2d2-7b4283a9d6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b3aa714dd44ad4a172bfb45ee2abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:00Z,use_quota=True,user_id='4a57d947c6134edcbb3642b05840a48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Creating volume 021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:00 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:00 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 1073741824 Apr 20 17:10:00 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772f3ad6-f59c-4e3f-97da-e738dd3a2b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1740f61-ec1d-4923-a514-aab0ed713fc9', 'volume_size': 1, 'snapshot_id': '158d2c8c-2463-4d86-b288-b6eee4a5743a'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e1d59-b5d0-4518-a28b-8913897cb114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:00 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Volume volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 (d1740f61-ec1d-4923-a514-aab0ed713fc9): created successfully Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e1d59-b5d0-4518-a28b-8913897cb114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Flow 'volume_create_manager' (cc9b0f4f-f175-4c23-85db-54f033df603a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:00 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f8f68712-e6a0-43ad-83d9-652e40a58fcd tempest-VolumesDeleteCascade-1406849053 None] Created volume successfully. Apr 20 17:10:01 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 1073741824" returned: 0 in 0.494s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:01 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 Apr 20 17:10:01 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-8db13c1a-a554-44a2-87b3-833795b5c05f-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-8db13c1a-a554-44a2-87b3-833795b5c05f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Performing cascade delete. {{(pid=82240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-158d2c8c-2463-4d86-b288-b6eee4a5743a-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-158d2c8c-2463-4d86-b288-b6eee4a5743a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-8db13c1a-a554-44a2-87b3-833795b5c05f" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-8db13c1a-a554-44a2-87b3-833795b5c05f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-158d2c8c-2463-4d86-b288-b6eee4a5743a" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-158d2c8c-2463-4d86-b288-b6eee4a5743a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Deleting offline snapshot 158d2c8c-2463-4d86-b288-b6eee4a5743a of volume 8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] snapshot_file for this snap is: volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ddef8-4d2f-4d5d-94f6-dc0a6e3e197c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:01 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a Apr 20 17:10:01 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:01 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8" returned: 0 in 0.464s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31774ec8-e950-4541-a73a-ca909a4deaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504a1b85-94d0-4d9e-8515-d73ea25c3ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:01 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Volume volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 (021b93ac-a572-498c-a2d2-7b4283a9d6c8): created successfully Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504a1b85-94d0-4d9e-8515-d73ea25c3ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:01 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Flow 'volume_create_manager' (942fcc0a-1e7b-459a-a02a-fcd94ebcd465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:01 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-66e08474-606a-47f5-8033-3d5dccfb9ae2 tempest-SnapshotDependencyTests-1174906411 None] Created volume successfully. Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Creating offline snapshot 6c13b6a0-4705-4fe1-903d-1a8635f7fc6c of volume 021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcab841-0aab-43a6-a798-f408db8b4c6a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:02 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a" returned: 0 in 0.535s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8db13c1a-a554-44a2-87b3-833795b5c05f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b50f380-972b-4438-9faa-6a887b931c11]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:02 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 Apr 20 17:10:02 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:02 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f Apr 20 17:10:02 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:02 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8" returned: 0 in 0.556s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:02 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f" returned: 0 in 0.543s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:02 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c 1G Apr 20 17:10:02 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:02 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a Apr 20 17:10:02 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:03 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a" returned: 0 in 0.472s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:03 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a Apr 20 17:10:03 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:03 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c 1G" returned: 0 in 0.525s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:03 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c Apr 20 17:10:03 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:03 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" returned: 0 in 0.584s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:03 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c is being set with open permissions: ugo+rw Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:03 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f.158d2c8c-2463-4d86-b288-b6eee4a5743a" returned: 0 in 0.629s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:03 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c Apr 20 17:10:03 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-158d2c8c-2463-4d86-b288-b6eee4a5743a" released by "_delete_snapshot" :: held 2.233s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-8db13c1a-a554-44a2-87b3-833795b5c05f" released by "delete_snapshot" :: held 2.249s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Created reservations ['bc6ae7f9-6ce8-4fd7-aab5-e2381cc5b53f', '403ba672-0003-4228-8843-3f0a0d1dd0c9', '256878c3-a417-46a8-918c-073f4cc5c14f', 'cae38e10-4b3d-4b03-9c1d-4dcf768a03b2'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:03 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Delete snapshot completed successfully. Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-158d2c8c-2463-4d86-b288-b6eee4a5743a-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Snapshots deleted, issuing volume delete {{(pid=82240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-8db13c1a-a554-44a2-87b3-833795b5c05f" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-8db13c1a-a554-44a2-87b3-833795b5c05f" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[06403c58-d16b-4d69-a89c-d5b35d4382b8]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:04 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f Apr 20 17:10:04 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:04 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" returned: 0 in 0.551s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:04 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.info Apr 20 17:10:04 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:04 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f" returned: 0 in 0.594s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:04 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f Apr 20 17:10:04 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:04 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.info" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:04 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.info is being set with open permissions: ugo+rw Apr 20 17:10:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:04 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.info Apr 20 17:10:04 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:05 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8db13c1a-a554-44a2-87b3-833795b5c05f" returned: 0 in 0.583s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-8db13c1a-a554-44a2-87b3-833795b5c05f" released by "delete_volume" :: held 1.211s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Created reservations ['a5a68a62-72ea-4aa4-b815-7512b26f067c', '2fab9c7d-ce93-4081-bb7a-22b95faf9391', '947bd81b-82b0-4f35-a5bb-bcb288b1c36f', '8bb84139-5738-4c2f-ab77-f7e667c066e9'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:05 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:05 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:05 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.info" returned: 0 in 0.505s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.315s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:05 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f9d5d179-e454-41bf-80f5-a95d5e675a7e tempest-SnapshotDependencyTests-1174906411 None] Create snapshot completed successfully Apr 20 17:10:05 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.440s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:05 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Deleted volume successfully. Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-42990a3c-8679-46e1-ad3c-3211402c003e tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-8db13c1a-a554-44a2-87b3-833795b5c05f-delete_volume" released by "delete_volume" :: held 4.167s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-d1740f61-ec1d-4923-a514-aab0ed713fc9-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-d1740f61-ec1d-4923-a514-aab0ed713fc9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "cinder-quobyte-d1740f61-ec1d-4923-a514-aab0ed713fc9" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-d1740f61-ec1d-4923-a514-aab0ed713fc9" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[798bcb13-679f-44aa-94d7-460157324117]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:06 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 Apr 20 17:10:06 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Flow 'volume_create_manager' (3c74aa16-baf9-4a32-942f-5078a3cc2f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f94f544-8713-4240-a6d5-a1e1ddf845d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f94f544-8713-4240-a6d5-a1e1ddf845d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1513572161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770ced8b-5915-4d5c-b2a2-5c788072a38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c4a763fa4b46dcb85e1c22f3a55415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:06Z,use_quota=True,user_id='afe42cbb820b46e88fedd9bf3d6912ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82084c7-b871-409b-8807-5d42d1390cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82084c7-b871-409b-8807-5d42d1390cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e78c85e-d090-45e5-aff9-40a5f395fb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e78c85e-d090-45e5-aff9-40a5f395fb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770ced8b-5915-4d5c-b2a2-5c788072a38c', 'volume_name': 'volume-770ced8b-5915-4d5c-b2a2-5c788072a38c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d084fd-073b-4891-bbf5-8858084f4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d084fd-073b-4891-bbf5-8858084f4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9288f5a3-04ef-4503-8e30-6bf43e0ae47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Volume 770ced8b-5915-4d5c-b2a2-5c788072a38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770ced8b-5915-4d5c-b2a2-5c788072a38c', 'volume_size': 1} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1513572161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770ced8b-5915-4d5c-b2a2-5c788072a38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c4a763fa4b46dcb85e1c22f3a55415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:06Z,use_quota=True,user_id='afe42cbb820b46e88fedd9bf3d6912ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Creating volume 770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:06 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:06 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9" returned: 0 in 0.558s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:06 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c 1073741824 Apr 20 17:10:06 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:06 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9 Apr 20 17:10:06 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Flow 'volume_create_manager' (8c3e78b4-0a7d-428d-8493-f79ad90da312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bf4181-1592-4fa0-a2d7-bbc823db59d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bf4181-1592-4fa0-a2d7-bbc823db59d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8f4a5c-7d52-43a4-93d6-08d960e320e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b3aa714dd44ad4a172bfb45ee2abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6c13b6a0-4705-4fe1-903d-1a8635f7fc6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:07Z,use_quota=True,user_id='4a57d947c6134edcbb3642b05840a48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8702ff3b-2c82-4485-b5bc-a695557a16bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8702ff3b-2c82-4485-b5bc-a695557a16bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e74e7b-2935-4e4c-9e03-727043f036c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e74e7b-2935-4e4c-9e03-727043f036c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc8f4a5c-7d52-43a4-93d6-08d960e320e1', 'volume_name': 'volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1', 'volume_size': 1, 'snapshot_id': '6c13b6a0-4705-4fe1-903d-1a8635f7fc6c'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb55d12-b756-472c-92f4-7b84d3d9aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb55d12-b756-472c-92f4-7b84d3d9aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fd15d1-b0b1-4b22-9ae2-4a9dd8d1c721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Volume dc8f4a5c-7d52-43a4-93d6-08d960e320e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1', 'volume_size': 1, 'snapshot_id': '6c13b6a0-4705-4fe1-903d-1a8635f7fc6c'} Apr 20 17:10:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:07 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d1740f61-ec1d-4923-a514-aab0ed713fc9" returned: 0 in 0.464s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-quobyte-d1740f61-ec1d-4923-a514-aab0ed713fc9" released by "delete_volume" :: held 1.056s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Created reservations ['d29ee8d8-ead9-43b1-89bd-d2166e5edf08', '42c032d6-9128-4f71-ad61-0f87bc936fe1', '2cf7f1c3-8952-4973-8145-9af2d54d583a', 'b8e83f9b-aceb-445f-9aa6-238f4b516039'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:07 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c 1073741824" returned: 0 in 0.588s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:07 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:07 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:07 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:10:07 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:07 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.424s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Deleted volume successfully. Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b929cb25-e801-45a9-9d9d-06f49facd751 tempest-VolumesDeleteCascade-1406849053 None] Lock "cinder-d1740f61-ec1d-4923-a514-aab0ed713fc9-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:07 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.440s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.912s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-quobyte-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" by "_create_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9288f5a3-04ef-4503-8e30-6bf43e0ae47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770ced8b-5915-4d5c-b2a2-5c788072a38c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffb12b0-6c5b-4bfb-b6fd-2927d8e9d42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Creating volume dc8f4a5c-7d52-43a4-93d6-08d960e320e1 from snapshot 6c13b6a0-4705-4fe1-903d-1a8635f7fc6c {{(pid=82240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-quobyte-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:07 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Volume volume-770ced8b-5915-4d5c-b2a2-5c788072a38c (770ced8b-5915-4d5c-b2a2-5c788072a38c): created successfully Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffb12b0-6c5b-4bfb-b6fd-2927d8e9d42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Flow 'volume_create_manager' (3c74aa16-baf9-4a32-942f-5078a3cc2f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] snapshot: 6c13b6a0-4705-4fe1-903d-1a8635f7fc6c, volume: dc8f4a5c-7d52-43a4-93d6-08d960e320e1, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:10:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4ce21c71-b21a-4329-8240-afb5971f1ae1 tempest-VolumesActionsTest-528061572 None] Created volume successfully. Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83f4b2-acf2-41cd-be44-15ff0b1afe23]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:07 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c Apr 20 17:10:07 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:08 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" returned: 0 in 0.500s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0ccdc7-16bd-466b-b5b2-99d342853b8d]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:08 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 Apr 20 17:10:08 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:08 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8" returned: 0 in 0.555s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:10:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:08 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 Apr 20 17:10:08 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=317,cinder:DELETE=25,cinder:SELECT=249,cinder:INSERT=82 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Flow 'volume_create_manager' (7fb4cf62-e043-4a2c-9dff-b1308b1cb30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd65771-3df8-422e-8c43-44f6999cfb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd65771-3df8-422e-8c43-44f6999cfb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1978616619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6acd662-acdc-49df-9675-923c778bd3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52104a1fa08b46289631c8e7025bef1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:11Z,use_quota=True,user_id='d11696132e224083acaf02339219ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e258f8db-471e-488f-8cd4-2d1764f3f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e258f8db-471e-488f-8cd4-2d1764f3f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d59ab56-02e7-4cf9-a1d1-0e42c9da64ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d59ab56-02e7-4cf9-a1d1-0e42c9da64ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6acd662-acdc-49df-9675-923c778bd3a6', 'volume_name': 'volume-e6acd662-acdc-49df-9675-923c778bd3a6', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cde451b-e64e-493f-9ced-207f452934f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cde451b-e64e-493f-9ced-207f452934f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858bae5b-2a2c-4499-a2a7-901cef16c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:10 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Volume e6acd662-acdc-49df-9675-923c778bd3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6acd662-acdc-49df-9675-923c778bd3a6', 'volume_size': 1} Apr 20 17:10:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:11 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" returned: 0 in 2.442s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:11 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c460fa61-50b8-4bd3-907f-aec9db87fd9f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:11 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 Apr 20 17:10:11 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:11 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8" returned: 0 in 0.596s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:11 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:10:11 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Converted 1024.00 MB image at 419.13 MB/s Apr 20 17:10:11 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 is being set with open permissions: ugo+rw Apr 20 17:10:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:11 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 Apr 20 17:10:11 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:12 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" returned: 0 in 0.435s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" released by "_copy_volume_from_snapshot" :: held 4.625s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" released by "_create_volume_from_snapshot" :: held 4.655s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.678s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1978616619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6acd662-acdc-49df-9675-923c778bd3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52104a1fa08b46289631c8e7025bef1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:11Z,use_quota=True,user_id='d11696132e224083acaf02339219ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Creating volume e6acd662-acdc-49df-9675-923c778bd3a6 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:12 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:12 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 1073741824 Apr 20 17:10:12 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fd15d1-b0b1-4b22-9ae2-4a9dd8d1c721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1', 'volume_size': 1, 'snapshot_id': '6c13b6a0-4705-4fe1-903d-1a8635f7fc6c'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b124c663-8a00-420d-960f-400130ee86c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:12 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Volume volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 (dc8f4a5c-7d52-43a4-93d6-08d960e320e1): created successfully Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b124c663-8a00-420d-960f-400130ee86c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Flow 'volume_create_manager' (8c3e78b4-0a7d-428d-8493-f79ad90da312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:12 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7ce20849-c957-4454-b6a5-391324891276 tempest-SnapshotDependencyTests-1174906411 None] Created volume successfully. Apr 20 17:10:12 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 1073741824" returned: 0 in 0.513s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:12 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 Apr 20 17:10:12 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-quobyte-021b93ac-a572-498c-a2d2-7b4283a9d6c8" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-021b93ac-a572-498c-a2d2-7b4283a9d6c8" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-quobyte-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Deleting offline snapshot 6c13b6a0-4705-4fe1-903d-1a8635f7fc6c of volume 021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] snapshot_file for this snap is: volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc605e3a-086c-45bc-a7cf-ddecd1a15f2f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:13 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6" returned: 0 in 0.445s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858bae5b-2a2c-4499-a2a7-901cef16c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6acd662-acdc-49df-9675-923c778bd3a6', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdcf762-a61e-4d35-927c-ccc8be8ce91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:13 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Volume volume-e6acd662-acdc-49df-9675-923c778bd3a6 (e6acd662-acdc-49df-9675-923c778bd3a6): created successfully Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdcf762-a61e-4d35-927c-ccc8be8ce91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Flow 'volume_create_manager' (7fb4cf62-e043-4a2c-9dff-b1308b1cb30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:13 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c Apr 20 17:10:13 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:13 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-68524616-1d57-49cc-b7a1-7fc7e5aec7d2 tempest-VolumesMetadataTest-499930496 None] Created volume successfully. Apr 20 17:10:13 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" returned: 0 in 0.496s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[29588096-7fdb-40f6-a53c-7964dc4abc58]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:13 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 Apr 20 17:10:13 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:14 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8" returned: 0 in 0.524s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:14 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c Apr 20 17:10:14 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Acquiring lock "cinder-e6acd662-acdc-49df-9675-923c778bd3a6-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Lock "cinder-e6acd662-acdc-49df-9675-923c778bd3a6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Acquiring lock "cinder-quobyte-e6acd662-acdc-49df-9675-923c778bd3a6" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Lock "cinder-quobyte-e6acd662-acdc-49df-9675-923c778bd3a6" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e059b933-d8fa-40f4-b16a-4627b16c0d71]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:14 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 Apr 20 17:10:14 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:14 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" returned: 0 in 0.450s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:14 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c Apr 20 17:10:14 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:14 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6" returned: 0 in 0.495s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:14 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6 Apr 20 17:10:14 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:15 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8.6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c" released by "_delete_snapshot" :: held 2.044s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-021b93ac-a572-498c-a2d2-7b4283a9d6c8" released by "delete_snapshot" :: held 2.065s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Created reservations ['c4264c29-3603-4d34-8b62-18639230c0ee', '805e102d-e5f1-44b3-a739-5d35a6f5593f', '1156855b-fc27-4ea0-a688-57957686c56a', 'f5132a5b-020c-47b5-8c29-bb55be7897f3'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:15 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Delete snapshot completed successfully. Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-262e7ff1-8a7e-4900-9ccb-92f857cf7bdb tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-6c13b6a0-4705-4fe1-903d-1a8635f7fc6c-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:15 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e6acd662-acdc-49df-9675-923c778bd3a6" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Lock "cinder-quobyte-e6acd662-acdc-49df-9675-923c778bd3a6" released by "delete_volume" :: held 0.968s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Created reservations ['8652a72f-582e-478e-bd13-b2b442a07f8b', '506b2476-b8a9-4124-a11b-de71ece1512e', 'c0d643f2-d4b7-4967-86d0-ed501e9ad538', '66303c27-dcdf-4242-bc93-115e9daaa8c0'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:15 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:15 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:15 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.542s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:15 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:15 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Deleted volume successfully. Apr 20 17:10:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-62e2ed9a-039d-4b19-840f-57d0e83a7e9c tempest-VolumesMetadataTest-499930496 None] Lock "cinder-e6acd662-acdc-49df-9675-923c778bd3a6-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-021b93ac-a572-498c-a2d2-7b4283a9d6c8-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-021b93ac-a572-498c-a2d2-7b4283a9d6c8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-quobyte-021b93ac-a572-498c-a2d2-7b4283a9d6c8" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-021b93ac-a572-498c-a2d2-7b4283a9d6c8" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:16 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe471ec-9343-4270-af26-77fef026baa6]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:16 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 Apr 20 17:10:16 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:17 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8" returned: 0 in 0.577s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:17 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8 Apr 20 17:10:17 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:17 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-021b93ac-a572-498c-a2d2-7b4283a9d6c8" returned: 0 in 0.534s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-021b93ac-a572-498c-a2d2-7b4283a9d6c8" released by "delete_volume" :: held 1.160s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Created reservations ['4d780b0f-eda6-4d22-bb01-d22184002df0', '5913928c-83b2-4263-905c-c47951847617', 'ed5cc825-811b-4a1a-93fe-8673f08144c7', '42b50494-a134-4683-8801-738cd720e58d'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:17 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:17 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:18 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.493s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:18 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Deleted volume successfully. Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb3bd18f-19aa-4432-bed7-d0c4fde3448c tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-021b93ac-a572-498c-a2d2-7b4283a9d6c8-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Flow 'volume_create_manager' (07a0c8ea-45d9-49bd-beef-0ce362badf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f2ded6-ddbd-4dcb-b963-333dba86b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f2ded6-ddbd-4dcb-b963-333dba86b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1466780141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e587c33-89e5-4a27-8ec2-9fcca1d293f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3671b39fc9de4522a363d8c9a2ca313f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:18Z,use_quota=True,user_id='8e5d32d6dc364fd1918df45ed592fdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64eba597-e2bc-4386-ab87-8b0f69e3a0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64eba597-e2bc-4386-ab87-8b0f69e3a0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098ef785-9e6b-4220-9ec0-dd20350a495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098ef785-9e6b-4220-9ec0-dd20350a495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e587c33-89e5-4a27-8ec2-9fcca1d293f8', 'volume_name': 'volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca52ed5-275a-4e68-81da-f463f85ef466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca52ed5-275a-4e68-81da-f463f85ef466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ca74ac-f99d-4bcf-876c-06c07af33696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:18 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Volume 9e587c33-89e5-4a27-8ec2-9fcca1d293f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8', 'volume_size': 1} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1466780141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e587c33-89e5-4a27-8ec2-9fcca1d293f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3671b39fc9de4522a363d8c9a2ca313f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:18Z,use_quota=True,user_id='8e5d32d6dc364fd1918df45ed592fdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Creating volume 9e587c33-89e5-4a27-8ec2-9fcca1d293f8 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:18 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:18 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 1073741824 Apr 20 17:10:18 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-dc8f4a5c-7d52-43a4-93d6-08d960e320e1-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-dc8f4a5c-7d52-43a4-93d6-08d960e320e1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "cinder-quobyte-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f119a0ae-796f-4d1b-b74a-68e0deb9045e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:18 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 Apr 20 17:10:18 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:18 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 1073741824" returned: 0 in 0.565s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:18 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 Apr 20 17:10:18 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:19 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:19 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1 Apr 20 17:10:19 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:19 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8" returned: 0 in 0.422s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ca74ac-f99d-4bcf-876c-06c07af33696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827c84b9-0830-4373-a0f3-f12ebd7d6901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:19 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Volume volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 (9e587c33-89e5-4a27-8ec2-9fcca1d293f8): created successfully Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827c84b9-0830-4373-a0f3-f12ebd7d6901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Flow 'volume_create_manager' (07a0c8ea-45d9-49bd-beef-0ce362badf73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:19 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d8a35c81-7cdf-42bc-abfb-83c14d581c2b tempest-VolumesTransfersV357Test-85971126 None] Created volume successfully. Apr 20 17:10:19 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" returned: 0 in 0.428s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-quobyte-dc8f4a5c-7d52-43a4-93d6-08d960e320e1" released by "delete_volume" :: held 0.984s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Created reservations ['27503cc3-ffbf-48d1-83bf-eb61b9081337', '300c6191-ee03-432c-9db4-d9c702ac4747', '8dbf8d36-504f-40b2-9a85-f5120df70fe1', 'd599a00d-29c6-4dca-a176-da534fb4004e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:19 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:19 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:20 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.429s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:20 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Deleted volume successfully. Apr 20 17:10:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-5357ba79-37df-4da6-a712-51a5da250177 tempest-SnapshotDependencyTests-1174906411 None] Lock "cinder-dc8f4a5c-7d52-43a4-93d6-08d960e320e1-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-d7d31bfe-3629-4401-b23d-3ff642fd524b tempest-VolumesTransfersV357Test-1142354426 None] Transfer volume completed successfully. Apr 20 17:10:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Acquiring lock "cinder-9e587c33-89e5-4a27-8ec2-9fcca1d293f8-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Lock "cinder-9e587c33-89e5-4a27-8ec2-9fcca1d293f8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Acquiring lock "cinder-quobyte-9e587c33-89e5-4a27-8ec2-9fcca1d293f8" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Lock "cinder-quobyte-9e587c33-89e5-4a27-8ec2-9fcca1d293f8" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:21 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a129091-6738-4140-a3f1-ba060fd08ad7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:21 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 Apr 20 17:10:21 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:22 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8" returned: 0 in 0.714s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:22 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8 Apr 20 17:10:22 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:22 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9e587c33-89e5-4a27-8ec2-9fcca1d293f8" returned: 0 in 0.546s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Lock "cinder-quobyte-9e587c33-89e5-4a27-8ec2-9fcca1d293f8" released by "delete_volume" :: held 1.290s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Created reservations ['557566da-cb89-4929-b346-e9455dfbfebe', '8ce50f3a-f4b8-4c06-8e86-2127742f3d2d', 'ac5d6904-ffe7-47b2-be74-9670a19b0a30', '91f8926a-9d0e-4f23-adcb-d4e32faf4c8c'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:23 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:23 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:23 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.609s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:23 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Deleted volume successfully. Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3e1e52b8-c00c-4c8b-93dd-3976f1129900 tempest-VolumesTransfersV357Test-200138210 None] Lock "cinder-9e587c33-89e5-4a27-8ec2-9fcca1d293f8-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dd661458-2d6e-4cdf-9e05-2f2ca2136eaf tempest-VolumesActionsTest-528061572 None] Acquiring lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c" by "attach_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dd661458-2d6e-4cdf-9e05-2f2ca2136eaf tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c" acquired by "attach_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=192,cinder:INSERT=67,cinder:UPDATE=270,cinder:DELETE=18 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:10:23 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-dd661458-2d6e-4cdf-9e05-2f2ca2136eaf tempest-VolumesActionsTest-528061572 None] Attaching volume 770ced8b-5915-4d5c-b2a2-5c788072a38c to instance 0b1537a9-e6b9-43d2-8ca9-d495128512b7 at mountpoint /dev/vdb on host None. Apr 20 17:10:23 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-dd661458-2d6e-4cdf-9e05-2f2ca2136eaf tempest-VolumesActionsTest-528061572 None] Attach volume completed successfully. Apr 20 17:10:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-dd661458-2d6e-4cdf-9e05-2f2ca2136eaf tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c" released by "attach_volume" :: held 0.079s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Flow 'volume_create_manager' (603774f8-889f-463e-a0a0-3e241dc7c9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebd6fed-32f9-4d78-bfd7-35e33078d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebd6fed-32f9-4d78-bfd7-35e33078d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-83845672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d679565-4783-4240-96d4-64a31fd098e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3671b39fc9de4522a363d8c9a2ca313f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:24Z,use_quota=True,user_id='8e5d32d6dc364fd1918df45ed592fdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adbb3e2-2283-4229-8066-e4918f63d835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adbb3e2-2283-4229-8066-e4918f63d835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202bc25e-cff8-41ed-8c3a-02b94e9dc1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202bc25e-cff8-41ed-8c3a-02b94e9dc1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d679565-4783-4240-96d4-64a31fd098e8', 'volume_name': 'volume-0d679565-4783-4240-96d4-64a31fd098e8', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b70033f-d840-4fee-8650-a4169067ab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b70033f-d840-4fee-8650-a4169067ab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6443c17-6f23-4019-94a7-dc02af3e9a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:24 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Volume 0d679565-4783-4240-96d4-64a31fd098e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d679565-4783-4240-96d4-64a31fd098e8', 'volume_size': 1} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-83845672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d679565-4783-4240-96d4-64a31fd098e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3671b39fc9de4522a363d8c9a2ca313f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:24Z,use_quota=True,user_id='8e5d32d6dc364fd1918df45ed592fdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Creating volume 0d679565-4783-4240-96d4-64a31fd098e8 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:24 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:24 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 1073741824 Apr 20 17:10:24 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2f68cdbe-adec-47de-9f5d-7415f84866c2 tempest-VolumesActionsTest-528061572 None] Acquiring lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-detach_volume" by "detach_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2f68cdbe-adec-47de-9f5d-7415f84866c2 tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:24 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-2f68cdbe-adec-47de-9f5d-7415f84866c2 tempest-VolumesActionsTest-528061572 None] Detaching volume 770ced8b-5915-4d5c-b2a2-5c788072a38c from instance 0b1537a9-e6b9-43d2-8ca9-d495128512b7. Apr 20 17:10:24 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-2f68cdbe-adec-47de-9f5d-7415f84866c2 tempest-VolumesActionsTest-528061572 None] Detach volume completed successfully. Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2f68cdbe-adec-47de-9f5d-7415f84866c2 tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:24 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 1073741824" returned: 0 in 0.577s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:24 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 Apr 20 17:10:24 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:25 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8" returned: 0 in 0.557s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6443c17-6f23-4019-94a7-dc02af3e9a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d679565-4783-4240-96d4-64a31fd098e8', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d93c18-9f05-43b9-b0fb-fd522bb89294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:25 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Volume volume-0d679565-4783-4240-96d4-64a31fd098e8 (0d679565-4783-4240-96d4-64a31fd098e8): created successfully Apr 20 17:10:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d93c18-9f05-43b9-b0fb-fd522bb89294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Flow 'volume_create_manager' (603774f8-889f-463e-a0a0-3e241dc7c9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3716b5e4-b38a-4ada-8d4d-4fa8b0576e12 tempest-VolumesTransfersV357Test-85971126 None] Created volume successfully. Apr 20 17:10:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Acquiring lock "cinder-0d679565-4783-4240-96d4-64a31fd098e8-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Lock "cinder-0d679565-4783-4240-96d4-64a31fd098e8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Acquiring lock "cinder-quobyte-0d679565-4783-4240-96d4-64a31fd098e8" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Lock "cinder-quobyte-0d679565-4783-4240-96d4-64a31fd098e8" acquired by "delete_volume" :: waited 0.018s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:26 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e2c3a-6adc-463c-aac0-6a6e1729cc55]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:26 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 Apr 20 17:10:26 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:27 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8" returned: 0 in 0.534s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:27 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8 Apr 20 17:10:27 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:27 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-0d679565-4783-4240-96d4-64a31fd098e8" returned: 0 in 0.570s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Lock "cinder-quobyte-0d679565-4783-4240-96d4-64a31fd098e8" released by "delete_volume" :: held 1.127s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Created reservations ['317fa698-f184-429c-b84a-fe8072eb97e6', 'db325d9c-b1af-4586-9e51-be8670933d97', '5dc914e8-6934-4eef-a0b6-0378b4f0ca94', '8cb0ab48-d4d2-4737-87ae-622520242099'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:27 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:27 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:28 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.514s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:28 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:28 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Deleted volume successfully. Apr 20 17:10:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-16c1836f-a1f4-4580-a19d-7a3abac9a3e0 tempest-VolumesTransfersV357Test-200138210 None] Lock "cinder-0d679565-4783-4240-96d4-64a31fd098e8-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:10:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:30 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:30 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:30 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.489s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Flow 'volume_create_manager' (91e7c680-303b-4b77-a51c-f162e181029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08c3604-9dd3-4f13-9e55-fa38f85b0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08c3604-9dd3-4f13-9e55-fa38f85b0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-239254709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a69190a-ff59-48b3-be5c-79b643c74574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8117d53c515a41e482f65d220a97ea45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:32Z,use_quota=True,user_id='78c9c6804dda498cb3acb95cc7c6a879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146d72bc-1cf1-4d7c-9f4b-519fd5924942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146d72bc-1cf1-4d7c-9f4b-519fd5924942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25724cf2-dfb5-48d7-b88f-65fdc5e9ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25724cf2-dfb5-48d7-b88f-65fdc5e9ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a69190a-ff59-48b3-be5c-79b643c74574', 'volume_name': 'volume-8a69190a-ff59-48b3-be5c-79b643c74574', 'volume_size': 2}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7191a16a-2499-4e5d-9f9b-b7d918d82b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7191a16a-2499-4e5d-9f9b-b7d918d82b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d989f6-3c55-4bcc-94ea-0fcbe548b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:32 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Volume 8a69190a-ff59-48b3-be5c-79b643c74574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a69190a-ff59-48b3-be5c-79b643c74574', 'volume_size': 2} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-239254709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a69190a-ff59-48b3-be5c-79b643c74574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8117d53c515a41e482f65d220a97ea45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:32Z,use_quota=True,user_id='78c9c6804dda498cb3acb95cc7c6a879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Creating volume 8a69190a-ff59-48b3-be5c-79b643c74574 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:32 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 2147483648 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:32 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 2147483648 Apr 20 17:10:32 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:32 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 2147483648" returned: 0 in 0.532s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:32 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 Apr 20 17:10:32 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:32 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574" returned: 0 in 0.408s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d989f6-3c55-4bcc-94ea-0fcbe548b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a69190a-ff59-48b3-be5c-79b643c74574', 'volume_size': 2}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:32 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a998cd7a-e92f-48c2-9a43-67dd850fa0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:32 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Volume volume-8a69190a-ff59-48b3-be5c-79b643c74574 (8a69190a-ff59-48b3-be5c-79b643c74574): created successfully Apr 20 17:10:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a998cd7a-e92f-48c2-9a43-67dd850fa0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Flow 'volume_create_manager' (91e7c680-303b-4b77-a51c-f162e181029d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:33 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e675c7ed-4def-444e-b5d3-58ae6cc8c967 tempest-VolumesCloneNegativeTest-1135736000 None] Created volume successfully. Apr 20 17:10:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Acquiring lock "cinder-8a69190a-ff59-48b3-be5c-79b643c74574-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "cinder-8a69190a-ff59-48b3-be5c-79b643c74574-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Acquiring lock "cinder-quobyte-8a69190a-ff59-48b3-be5c-79b643c74574" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "cinder-quobyte-8a69190a-ff59-48b3-be5c-79b643c74574" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:34 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f57b8de-5d8e-49b8-9f1b-8b049c302314]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:34 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 Apr 20 17:10:34 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:34 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574" returned: 0 in 0.471s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:34 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574 Apr 20 17:10:34 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:35 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-8a69190a-ff59-48b3-be5c-79b643c74574" returned: 0 in 0.391s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "cinder-quobyte-8a69190a-ff59-48b3-be5c-79b643c74574" released by "delete_volume" :: held 0.883s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Created reservations ['86435394-9a8d-42ee-8330-933718e9cd2e', '2297c8be-d26c-4ea3-8659-bb98c11ec843', '52da74b8-5c82-4b9f-af0f-32cef113c712', '7028a199-6c80-4dd3-94f6-c20c669c951f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:35 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:35 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:35 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.463s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:35 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Deleted volume successfully. Apr 20 17:10:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3eb01f47-5825-454e-b895-4c3c2af82ec6 tempest-VolumesCloneNegativeTest-1135736000 None] Lock "cinder-8a69190a-ff59-48b3-be5c-79b643c74574-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Flow 'volume_create_manager' (6f91f824-66dc-45ed-a681-083747b5cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b5b620-d1c7-49db-8570-299c2fe029f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b5b620-d1c7-49db-8570-299c2fe029f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-6219764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da39dd8-c387-425d-af46-a31cff096771,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d4202a9fd44819d0651e53f8a080a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:37Z,use_quota=True,user_id='b374564fed40496c8a72395d4ee7d021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28b9e87-30f8-48f4-9464-c1d4ea3b1c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28b9e87-30f8-48f4-9464-c1d4ea3b1c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3483bcd7-243e-496c-a894-8e673d7c75d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3483bcd7-243e-496c-a894-8e673d7c75d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da39dd8-c387-425d-af46-a31cff096771', 'volume_name': 'volume-9da39dd8-c387-425d-af46-a31cff096771', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99d265a-5e6a-4c98-91fc-1426c2946361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99d265a-5e6a-4c98-91fc-1426c2946361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01ef83d-9e5c-4e4c-a46a-39beee99dfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:37 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Volume 9da39dd8-c387-425d-af46-a31cff096771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da39dd8-c387-425d-af46-a31cff096771', 'volume_size': 1} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-6219764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da39dd8-c387-425d-af46-a31cff096771,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d4202a9fd44819d0651e53f8a080a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:37Z,use_quota=True,user_id='b374564fed40496c8a72395d4ee7d021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Creating volume 9da39dd8-c387-425d-af46-a31cff096771 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:37 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:37 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 1073741824 Apr 20 17:10:37 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:37 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 1073741824" returned: 0 in 0.535s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:37 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 Apr 20 17:10:37 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:38 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771" returned: 0 in 0.414s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01ef83d-9e5c-4e4c-a46a-39beee99dfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da39dd8-c387-425d-af46-a31cff096771', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49f9ad5-d30c-4658-a30a-d22961a14343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Volume volume-9da39dd8-c387-425d-af46-a31cff096771 (9da39dd8-c387-425d-af46-a31cff096771): created successfully Apr 20 17:10:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49f9ad5-d30c-4658-a30a-d22961a14343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Flow 'volume_create_manager' (6f91f824-66dc-45ed-a681-083747b5cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-2f4b8654-f4e8-46bc-b82c-72329a2b2e96 tempest-VolumesListTestJSON-1655587147 None] Created volume successfully. Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Flow 'volume_create_manager' (212c9348-8461-49fb-b8a0-edd0473dc6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec557d1-b6e7-4b15-a016-f4c3b6c7e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec557d1-b6e7-4b15-a016-f4c3b6c7e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1511623287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69926d46-0247-4bbd-b90f-618ec5b26109,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d4202a9fd44819d0651e53f8a080a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:39Z,use_quota=True,user_id='b374564fed40496c8a72395d4ee7d021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f102ab91-239e-4edd-8c25-1ffc99e7f765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f102ab91-239e-4edd-8c25-1ffc99e7f765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0aed80-1243-40e0-8444-2bc5e344f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0aed80-1243-40e0-8444-2bc5e344f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69926d46-0247-4bbd-b90f-618ec5b26109', 'volume_name': 'volume-69926d46-0247-4bbd-b90f-618ec5b26109', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a5fde7-d571-4ece-a867-0a081ef1f1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a5fde7-d571-4ece-a867-0a081ef1f1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db25e98-16fa-44c3-917c-2724f04e83f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:39 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Volume 69926d46-0247-4bbd-b90f-618ec5b26109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69926d46-0247-4bbd-b90f-618ec5b26109', 'volume_size': 1} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1511623287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69926d46-0247-4bbd-b90f-618ec5b26109,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d4202a9fd44819d0651e53f8a080a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:39Z,use_quota=True,user_id='b374564fed40496c8a72395d4ee7d021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Creating volume 69926d46-0247-4bbd-b90f-618ec5b26109 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:39 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:39 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 1073741824 Apr 20 17:10:39 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:39 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 1073741824" returned: 0 in 0.498s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:39 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 Apr 20 17:10:39 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:40 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109" returned: 0 in 0.424s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db25e98-16fa-44c3-917c-2724f04e83f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69926d46-0247-4bbd-b90f-618ec5b26109', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a6c91b-dced-4565-9092-4bdebc6f8a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:40 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Volume volume-69926d46-0247-4bbd-b90f-618ec5b26109 (69926d46-0247-4bbd-b90f-618ec5b26109): created successfully Apr 20 17:10:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a6c91b-dced-4565-9092-4bdebc6f8a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:40 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Flow 'volume_create_manager' (212c9348-8461-49fb-b8a0-edd0473dc6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:40 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1f6681a1-b277-4867-b78c-69c758c7aca6 tempest-VolumesListTestJSON-1655587147 None] Created volume successfully. Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Flow 'volume_create_manager' (912937c1-3e5b-4e25-9f2a-c1774de27c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b611e70a-eb8f-4e83-b8a1-4de50715806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b611e70a-eb8f-4e83-b8a1-4de50715806d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1388990913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877393dd-b96a-47ce-89b5-d77ee8a13f20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d4202a9fd44819d0651e53f8a080a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:42Z,use_quota=True,user_id='b374564fed40496c8a72395d4ee7d021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bbffa4-69a2-4ca6-96f7-b684cde5731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bbffa4-69a2-4ca6-96f7-b684cde5731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ed8b6a-00e1-4046-a0d5-c7ec211f8624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ed8b6a-00e1-4046-a0d5-c7ec211f8624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877393dd-b96a-47ce-89b5-d77ee8a13f20', 'volume_name': 'volume-877393dd-b96a-47ce-89b5-d77ee8a13f20', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fa0abe-38f2-4ff3-b702-558cb9b3a3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fa0abe-38f2-4ff3-b702-558cb9b3a3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082ad12e-18f7-4056-bc46-19af19c7abfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:41 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Volume 877393dd-b96a-47ce-89b5-d77ee8a13f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877393dd-b96a-47ce-89b5-d77ee8a13f20', 'volume_size': 1} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1388990913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877393dd-b96a-47ce-89b5-d77ee8a13f20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d4202a9fd44819d0651e53f8a080a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:42Z,use_quota=True,user_id='b374564fed40496c8a72395d4ee7d021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Creating volume 877393dd-b96a-47ce-89b5-d77ee8a13f20 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:41 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:41 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 1073741824 Apr 20 17:10:41 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:42 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 1073741824" returned: 0 in 0.687s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:42 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 Apr 20 17:10:42 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:42 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082ad12e-18f7-4056-bc46-19af19c7abfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877393dd-b96a-47ce-89b5-d77ee8a13f20', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c43f783-9cfe-4f9b-bfae-7e65b379580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:42 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Volume volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 (877393dd-b96a-47ce-89b5-d77ee8a13f20): created successfully Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c43f783-9cfe-4f9b-bfae-7e65b379580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Flow 'volume_create_manager' (912937c1-3e5b-4e25-9f2a-c1774de27c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-75f69c16-ea7c-4393-a646-ed175b493471 tempest-VolumesListTestJSON-1655587147 None] Created volume successfully. Apr 20 17:10:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4ff2de61-d810-431f-ba3d-d25d6f8eaa81 tempest-VolumesActionsTest-528061572 None] Acquiring lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c" by "attach_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4ff2de61-d810-431f-ba3d-d25d6f8eaa81 tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c" acquired by "attach_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:44 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4ff2de61-d810-431f-ba3d-d25d6f8eaa81 tempest-VolumesActionsTest-528061572 None] Attaching volume 770ced8b-5915-4d5c-b2a2-5c788072a38c to instance fe8f563b-b3c5-4e63-887e-1c2a75c8314a at mountpoint /dev/vdb on host None. Apr 20 17:10:44 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4ff2de61-d810-431f-ba3d-d25d6f8eaa81 tempest-VolumesActionsTest-528061572 None] Attach volume completed successfully. Apr 20 17:10:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4ff2de61-d810-431f-ba3d-d25d6f8eaa81 tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c" released by "attach_volume" :: held 0.069s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0d2f3a04-0768-4ed9-919f-5895e00ba2fc tempest-VolumesActionsTest-528061572 None] Acquiring lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-detach_volume" by "detach_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0d2f3a04-0768-4ed9-919f-5895e00ba2fc tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-detach_volume" acquired by "detach_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:45 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0d2f3a04-0768-4ed9-919f-5895e00ba2fc tempest-VolumesActionsTest-528061572 None] Detaching volume 770ced8b-5915-4d5c-b2a2-5c788072a38c from instance fe8f563b-b3c5-4e63-887e-1c2a75c8314a. Apr 20 17:10:45 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0d2f3a04-0768-4ed9-919f-5895e00ba2fc tempest-VolumesActionsTest-528061572 None] Detach volume completed successfully. Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-0d2f3a04-0768-4ed9-919f-5895e00ba2fc tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "cinder-877393dd-b96a-47ce-89b5-d77ee8a13f20-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-877393dd-b96a-47ce-89b5-d77ee8a13f20-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "cinder-quobyte-877393dd-b96a-47ce-89b5-d77ee8a13f20" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-quobyte-877393dd-b96a-47ce-89b5-d77ee8a13f20" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1269031-1f2b-42c8-98d6-00c82c3632cf]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:45 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 Apr 20 17:10:45 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:46 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20" returned: 0 in 0.507s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:46 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20 Apr 20 17:10:46 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:46 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-877393dd-b96a-47ce-89b5-d77ee8a13f20" returned: 0 in 0.439s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-quobyte-877393dd-b96a-47ce-89b5-d77ee8a13f20" released by "delete_volume" :: held 0.995s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Created reservations ['8c96411f-0ca3-4378-abc3-fc94f4f1a88e', 'ff2f53df-c552-43e2-9832-f0d7c345a4ca', 'f98b6971-9f09-458e-bc79-58866e15b62d', '5fbfa5dd-0e78-4791-936f-5fe4cbefb49f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:46 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:46 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "cinder-69926d46-0247-4bbd-b90f-618ec5b26109-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-69926d46-0247-4bbd-b90f-618ec5b26109-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "cinder-quobyte-69926d46-0247-4bbd-b90f-618ec5b26109" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-quobyte-69926d46-0247-4bbd-b90f-618ec5b26109" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bce0cd0-409f-4a3c-ab92-c672a5abc7b5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:47 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 Apr 20 17:10:47 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:47 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.639s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:47 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:47 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Deleted volume successfully. Apr 20 17:10:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eb5ab56f-fe74-4312-955a-4f98358549e4 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-877393dd-b96a-47ce-89b5-d77ee8a13f20-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:47 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109" returned: 0 in 0.607s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:47 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109 Apr 20 17:10:47 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:48 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-69926d46-0247-4bbd-b90f-618ec5b26109" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-quobyte-69926d46-0247-4bbd-b90f-618ec5b26109" released by "delete_volume" :: held 1.089s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Created reservations ['a64a4a3f-4bc0-40cf-a746-18cc2ce8fe63', '597f594b-2cf5-44c5-a2e5-42a5b12b87e5', '1656eb10-a65d-4388-aa5b-7d31069d3b25', 'f8d2ce36-37c3-4d52-a74e-c51345461dfa'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:48 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:48 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:48 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.428s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:48 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Deleted volume successfully. Apr 20 17:10:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e161612d-0d7f-4e8f-bbb7-7bab7179bac9 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-69926d46-0247-4bbd-b90f-618ec5b26109-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "cinder-9da39dd8-c387-425d-af46-a31cff096771-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-9da39dd8-c387-425d-af46-a31cff096771-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "cinder-quobyte-9da39dd8-c387-425d-af46-a31cff096771" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:10:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-quobyte-9da39dd8-c387-425d-af46-a31cff096771" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:10:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a27030-6fd2-4955-920e-aaf7d795b2fd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:49 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 Apr 20 17:10:49 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:49 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771" returned: 0 in 0.474s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:49 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771 Apr 20 17:10:49 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:50 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9da39dd8-c387-425d-af46-a31cff096771" returned: 0 in 0.424s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-quobyte-9da39dd8-c387-425d-af46-a31cff096771" released by "delete_volume" :: held 0.920s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Created reservations ['35d1b09a-4b09-488d-8d0b-53ff5415577c', '98871b78-17d8-4955-93cf-417690e9a468', '503d5368-a718-4fa1-9256-82ff3c79c40c', 'f34585d3-c035-461f-886f-82f2fbb5c631'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:50 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:10:50 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:50 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.458s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:10:50 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Deleted volume successfully. Apr 20 17:10:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-58d00891-2f3c-4880-8212-4ee224b2cf29 tempest-VolumesListTestJSON-1655587147 None] Lock "cinder-9da39dd8-c387-425d-af46-a31cff096771-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Flow 'volume_create_manager' (43636583-5ded-4303-9c2f-46b07081e135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a45cea7-46bc-4d3b-aae1-673b9cc20794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a45cea7-46bc-4d3b-aae1-673b9cc20794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1277579690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929af885-3250-4ce0-824b-af323d65c0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f3794309224080b5e2c9fc112f5b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:52Z,use_quota=True,user_id='cf39b5880efd4533b0790e879fb4997d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a72430-24b4-4758-bb58-3e8f259648cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a72430-24b4-4758-bb58-3e8f259648cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cda484d-2260-47e6-8e14-534ef61680c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cda484d-2260-47e6-8e14-534ef61680c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929af885-3250-4ce0-824b-af323d65c0fc', 'volume_name': 'volume-929af885-3250-4ce0-824b-af323d65c0fc', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacd10fb-75fe-453e-8d4d-9e061e1184c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacd10fb-75fe-453e-8d4d-9e061e1184c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cdaf0c-70e5-4154-b194-2b4379555d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:52 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Volume 929af885-3250-4ce0-824b-af323d65c0fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929af885-3250-4ce0-824b-af323d65c0fc', 'volume_size': 1} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1277579690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929af885-3250-4ce0-824b-af323d65c0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f3794309224080b5e2c9fc112f5b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:10:52Z,use_quota=True,user_id='cf39b5880efd4533b0790e879fb4997d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Creating volume 929af885-3250-4ce0-824b-af323d65c0fc {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:10:52 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:52 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc 1073741824 Apr 20 17:10:52 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:52 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc 1073741824" returned: 0 in 0.556s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:52 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc Apr 20 17:10:52 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:53 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc" returned: 0 in 0.440s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cdaf0c-70e5-4154-b194-2b4379555d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929af885-3250-4ce0-824b-af323d65c0fc', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46dac21-51b3-4351-85d3-7ee366133a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:10:53 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Volume volume-929af885-3250-4ce0-824b-af323d65c0fc (929af885-3250-4ce0-824b-af323d65c0fc): created successfully Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46dac21-51b3-4351-85d3-7ee366133a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Flow 'volume_create_manager' (43636583-5ded-4303-9c2f-46b07081e135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:10:53 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-beff2815-a9ce-40ff-9dce-c6bb4c447e68 tempest-VolumesNegativeTest-1914530114 None] Created volume successfully. Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acbdbad-f4d4-420e-b4c0-c58bc726e3e7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:53 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:10:53 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:53 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.456s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3c0866-7aec-44fc-a339-06b2322a9e44]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:53 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:10:53 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:54 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.469s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.30b1a9e7-ff31-4d05-a4be-76f7674cb1972zhv9nm5.img {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:54 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.30b1a9e7-ff31-4d05-a4be-76f7674cb1972zhv9nm5.img Apr 20 17:10:54 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:56 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.30b1a9e7-ff31-4d05-a4be-76f7674cb1972zhv9nm5.img" returned: 0 in 2.192s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:56 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec576ef6-8362-4b44-934a-db987a1f74ec]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:10:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:10:56 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:10:56 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:10:56 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 20 17:10:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.623s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:10:56 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.30b1a9e7-ff31-4d05-a4be-76f7674cb1972zhv9nm5.img {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:10:56 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Converted 1024.00 MB image at 466.83 MB/s Apr 20 17:10:57 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] 30b1a9e7-ff31-4d05-a4be-76f7674cb197 was raw, no need to convert to raw {{(pid=82240) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Apr 20 17:11:03 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=105,cinder:DELETE=8,cinder:SELECT=83,cinder:INSERT=23 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:11:07 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=47,cinder:UPDATE=61,cinder:INSERT=14,cinder:DELETE=7 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:11:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.102s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Uploaded volume to glance image-id: 30b1a9e7-ff31-4d05-a4be-76f7674cb197. {{(pid=82240) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 20 17:11:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-878cbdd9-acf4-47d4-a8c6-7b3b43f00e00 tempest-VolumesActionsTest-528061572 None] Copy volume to image completed successfully. Apr 20 17:11:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:08 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[58efb07a-cac3-417d-9758-74e14800693a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:08 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:11:08 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:08 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.493s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:08 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd106b-9583-4a18-8440-89414469ce06]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:08 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:11:08 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:09 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:09 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img Apr 20 17:11:09 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:11 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img" returned: 0 in 2.071s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:11 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8791882d-baa4-43bd-b108-8788f0aa4a96]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:11 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:11:11 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:11 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.586s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:11 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:11:11 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Converted 1024.00 MB image at 493.99 MB/s Apr 20 17:11:11 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] 3700e59b-2e28-41c2-b4ec-def89592bafe was raw, converting to qcow2 {{(pid=82240) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Apr 20 17:11:12 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda3c9ca-2387-4e53-ac87-23b1a5a31e64]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:12 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img Apr 20 17:11:12 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:12 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img" returned: 0 in 0.458s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:12 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img Apr 20 17:11:12 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:12 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img" returned: 1 in 0.493s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:11:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img /opt/stack/data/cinder/conversion/vol_upload_m3vc93we {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:12 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img /opt/stack/data/cinder/conversion/vol_upload_m3vc93we Apr 20 17:11:12 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:13 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img /opt/stack/data/cinder/conversion/vol_upload_m3vc93we" returned: 0 in 0.424s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:13 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Image conversion details: src /opt/stack/data/cinder/conversion/770ced8b-5915-4d5c-b2a2-5c788072a38c.temp_image.3700e59b-2e28-41c2-b4ec-def89592bafenv9o_8kz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_m3vc93we {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:11:13 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 20 17:11:13 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bdd048-c817-4fb9-b9f6-d8f926f00ccf]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m3vc93we {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:13 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m3vc93we Apr 20 17:11:13 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:13 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m3vc93we" returned: 0 in 0.446s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.369s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Uploaded volume to glance image-id: 3700e59b-2e28-41c2-b4ec-def89592bafe. {{(pid=82240) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 20 17:11:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-01df6036-e259-465a-a100-15e28d184319 tempest-VolumesActionsTest-528061572 None] Copy volume to image completed successfully. Apr 20 17:11:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Acquiring lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Acquiring lock "cinder-quobyte-770ced8b-5915-4d5c-b2a2-5c788072a38c" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Lock "cinder-quobyte-770ced8b-5915-4d5c-b2a2-5c788072a38c" acquired by "delete_volume" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:15 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d43f95b-8e20-468c-818d-56f106f5b967]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:16 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:11:16 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:16 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.516s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:16 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c Apr 20 17:11:16 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:16 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-770ced8b-5915-4d5c-b2a2-5c788072a38c" returned: 0 in 0.450s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Lock "cinder-quobyte-770ced8b-5915-4d5c-b2a2-5c788072a38c" released by "delete_volume" :: held 0.996s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:16 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Created reservations ['b34421a0-fbc7-43ca-b28b-f275480da869', '22c9f96b-55ef-4514-a2f6-82987cc9a655', '36de1b54-b2e6-4578-ad44-af0281caf7a7', '836f9a82-6a2a-4943-a469-b0f3fad34aa5'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:17 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:17 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:17 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.434s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:17 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Deleted volume successfully. Apr 20 17:11:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-38c122ca-950b-4546-a769-732d43491eb1 tempest-VolumesActionsTest-528061572 None] Lock "cinder-770ced8b-5915-4d5c-b2a2-5c788072a38c-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Acquiring lock "cinder-929af885-3250-4ce0-824b-af323d65c0fc-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Lock "cinder-929af885-3250-4ce0-824b-af323d65c0fc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Acquiring lock "cinder-quobyte-929af885-3250-4ce0-824b-af323d65c0fc" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Lock "cinder-quobyte-929af885-3250-4ce0-824b-af323d65c0fc" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:18 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b0265-6bdb-4c30-8c07-5c56b38ea909]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:19 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc Apr 20 17:11:19 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:19 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:19 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc Apr 20 17:11:19 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:19 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-929af885-3250-4ce0-824b-af323d65c0fc" returned: 0 in 0.465s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Lock "cinder-quobyte-929af885-3250-4ce0-824b-af323d65c0fc" released by "delete_volume" :: held 1.021s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:19 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Created reservations ['0d178f51-67a6-408f-9a7b-a003cb2f6271', 'd8d5849f-8167-458b-a43e-548c613de3ef', '7876dbf3-4d46-4c02-a3c6-4307c109bb24', '391d8b86-ae67-45ed-aee6-ab22790d1cad'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:20 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:20 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:20 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.453s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Deleted volume successfully. Apr 20 17:11:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-831f07c2-f17f-403b-8d4f-14040e6730cb tempest-VolumesNegativeTest-1914530114 None] Lock "cinder-929af885-3250-4ce0-824b-af323d65c0fc-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:21 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Flow 'volume_create_manager' (2dba78e2-b9f3-4919-b843-dfd76ee9a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164d709f-0c23-4f43-995b-abe5ba9d5069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164d709f-0c23-4f43-995b-abe5ba9d5069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-994150726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a910f8ed-fac2-4209-ad01-55c7ab50d8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b35fd46b0649dc93d347e3f534d87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:22Z,use_quota=True,user_id='fda6e20cea80479db03cc484c28a3717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bada60e-6570-4a49-a91c-7d48a34382ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bada60e-6570-4a49-a91c-7d48a34382ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d33b87-fb04-4832-90b3-4709cb987da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d33b87-fb04-4832-90b3-4709cb987da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a910f8ed-fac2-4209-ad01-55c7ab50d8ae', 'volume_name': 'volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c9cc45-3cf5-412a-baa6-15ee0eb9b644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c9cc45-3cf5-412a-baa6-15ee0eb9b644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f5f8ad-daf0-45c5-842d-1e848a9bf2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Volume a910f8ed-fac2-4209-ad01-55c7ab50d8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae', 'volume_size': 1} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-994150726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a910f8ed-fac2-4209-ad01-55c7ab50d8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b35fd46b0649dc93d347e3f534d87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:22Z,use_quota=True,user_id='fda6e20cea80479db03cc484c28a3717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Creating volume a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:22 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:22 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae 1073741824 Apr 20 17:11:22 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:22 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (663e283f-9253-4fd4-922d-9e140c90dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33abec0-b822-4dc5-b28a-a302964bd1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae 1073741824" returned: 0 in 0.556s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33abec0-b822-4dc5-b28a-a302964bd1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-882773998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae470d83-8ac2-4dad-8708-ef35934271d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cf21a2-c52c-42d6-a898-e089ea05464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cf21a2-c52c-42d6-a898-e089ea05464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d537b3-b635-4038-a3dc-49f36fbe6b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d537b3-b635-4038-a3dc-49f36fbe6b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae470d83-8ac2-4dad-8708-ef35934271d9', 'volume_name': 'volume-ae470d83-8ac2-4dad-8708-ef35934271d9', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2bdb36-deee-4c1d-8676-9acd5f9319bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2bdb36-deee-4c1d-8676-9acd5f9319bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a49c9f-c6e8-4847-8251-dc1a8300feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Volume ae470d83-8ac2-4dad-8708-ef35934271d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae470d83-8ac2-4dad-8708-ef35934271d9', 'volume_size': 1} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:22 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae Apr 20 17:11:22 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (a929d504-af36-475a-9336-cf45328cf790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32bf289-bb37-4fd1-a177-45dfda0b8fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32bf289-bb37-4fd1-a177-45dfda0b8fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576539736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852d933a-4523-4be2-96fc-b3f3de709f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3917a313-68b7-4711-9199-b44ae42152ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3917a313-68b7-4711-9199-b44ae42152ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01f6086-ba24-4e78-8514-7ba976975e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01f6086-ba24-4e78-8514-7ba976975e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852d933a-4523-4be2-96fc-b3f3de709f78', 'volume_name': 'volume-852d933a-4523-4be2-96fc-b3f3de709f78', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbb44f1-7f47-4e47-a51a-f5914078e1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbb44f1-7f47-4e47-a51a-f5914078e1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340b6f69-8ddc-49f9-97e4-b9b55d5f4441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:22 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Volume 852d933a-4523-4be2-96fc-b3f3de709f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852d933a-4523-4be2-96fc-b3f3de709f78', 'volume_size': 1} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (90ebe4ea-d0eb-4a61-a3c7-d80b3f54a517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:22 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7094193f-229d-4211-bd97-623a4fde75f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7094193f-229d-4211-bd97-623a4fde75f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87987870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c148aeb-1e9a-4f84-956a-f6133ad95bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88cfb05-1491-480c-9b6e-d0e666c38a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88cfb05-1491-480c-9b6e-d0e666c38a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2deff33e-8dab-4d96-ac82-dabc3e35d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2deff33e-8dab-4d96-ac82-dabc3e35d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c148aeb-1e9a-4f84-956a-f6133ad95bbc', 'volume_name': 'volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddedc9c8-8dc6-4516-93f3-f3753c9fc837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddedc9c8-8dc6-4516-93f3-f3753c9fc837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e2d13d-6f1c-42b9-b917-9b68d143d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Volume 1c148aeb-1e9a-4f84-956a-f6133ad95bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc', 'volume_size': 1} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:23 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" returned: 0 in 0.476s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-882773998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae470d83-8ac2-4dad-8708-ef35934271d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Creating volume ae470d83-8ac2-4dad-8708-ef35934271d9 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:23 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f5f8ad-daf0-45c5-842d-1e848a9bf2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9717e94-1257-44b7-97c6-f0432566f42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 1073741824 Apr 20 17:11:23 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:23 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Volume volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae (a910f8ed-fac2-4209-ad01-55c7ab50d8ae): created successfully Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9717e94-1257-44b7-97c6-f0432566f42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Flow 'volume_create_manager' (2dba78e2-b9f3-4919-b843-dfd76ee9a20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:23 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c568b4df-254a-47fe-b6e4-441ec68edc3e tempest-VolumesCloneTest-820440002 None] Created volume successfully. Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (bca527e9-5145-4e83-b7cc-0a393e01df68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050f96a5-ef2d-492d-995f-0b60e3b7904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050f96a5-ef2d-492d-995f-0b60e3b7904f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757791602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19513785-e106-4413-a49e-164ba9e587c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f587d3-28ef-46d1-93ec-136d3f79f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f587d3-28ef-46d1-93ec-136d3f79f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5e991a-5440-4bad-87c0-1c98efe03f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5e991a-5440-4bad-87c0-1c98efe03f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19513785-e106-4413-a49e-164ba9e587c5', 'volume_name': 'volume-19513785-e106-4413-a49e-164ba9e587c5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29382640-6070-4189-b777-8d52296a5c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29382640-6070-4189-b777-8d52296a5c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf58d1a-fdbd-425e-8d04-37777504e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Volume 19513785-e106-4413-a49e-164ba9e587c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19513785-e106-4413-a49e-164ba9e587c5', 'volume_size': 1} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (cb695181-79cf-48a6-b807-5e8ee95491e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea00ed8-0910-4707-991d-158399986073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea00ed8-0910-4707-991d-158399986073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-170458589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eee0d6a-8486-4d10-acbd-e29385da6b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b84ee4-80f6-4d99-b0e5-dd546453f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b84ee4-80f6-4d99-b0e5-dd546453f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811d169b-1388-42e3-a727-abdab45b9b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811d169b-1388-42e3-a727-abdab45b9b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eee0d6a-8486-4d10-acbd-e29385da6b05', 'volume_name': 'volume-5eee0d6a-8486-4d10-acbd-e29385da6b05', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4263b144-35af-4176-8f1d-c30a44c362ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4263b144-35af-4176-8f1d-c30a44c362ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c656c4cf-d211-4f65-84b3-5fba1fa15677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:23 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Volume 5eee0d6a-8486-4d10-acbd-e29385da6b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eee0d6a-8486-4d10-acbd-e29385da6b05', 'volume_size': 1} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:23 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 1073741824" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:23 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 Apr 20 17:11:23 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:24 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9" returned: 0 in 0.430s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576539736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852d933a-4523-4be2-96fc-b3f3de709f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Creating volume 852d933a-4523-4be2-96fc-b3f3de709f78 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:24 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a49c9f-c6e8-4847-8251-dc1a8300feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae470d83-8ac2-4dad-8708-ef35934271d9', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:24 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 1073741824 Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a1dd0f-90e3-403f-ab83-662c00fad587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:24 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:24 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Volume volume-ae470d83-8ac2-4dad-8708-ef35934271d9 (ae470d83-8ac2-4dad-8708-ef35934271d9): created successfully Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a1dd0f-90e3-403f-ab83-662c00fad587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (663e283f-9253-4fd4-922d-9e140c90dde4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:24 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-24d3ae38-1ad3-477a-b7ed-fadb88c71cf5 tempest-CreateVolumesFromImageTest-2009399298 None] Created volume successfully. Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Flow 'volume_create_manager' (b017da93-71ff-4733-96c6-9ac9d7e6a80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd43ec3-b665-4ccb-a5fe-27ad38504b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd43ec3-b665-4ccb-a5fe-27ad38504b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-5275124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4517e1e8-3e0b-47b1-93e6-64c50f062ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b35fd46b0649dc93d347e3f534d87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a910f8ed-fac2-4209-ad01-55c7ab50d8ae,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:24Z,use_quota=True,user_id='fda6e20cea80479db03cc484c28a3717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7068432a-f13b-4dac-9073-23675ee1049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7068432a-f13b-4dac-9073-23675ee1049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecd199a-e838-49ac-b8e8-cc74b8dff493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecd199a-e838-49ac-b8e8-cc74b8dff493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4517e1e8-3e0b-47b1-93e6-64c50f062ff8', 'volume_name': 'volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8', 'volume_size': 2, 'source_volid': 'a910f8ed-fac2-4209-ad01-55c7ab50d8ae', 'source_volstatus': 'available'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0af0362-ced4-4b5f-9f8e-572ddc60a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0af0362-ced4-4b5f-9f8e-572ddc60a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b59760e-4541-43b3-8c71-77e01d6d7614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:24 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Volume 4517e1e8-3e0b-47b1-93e6-64c50f062ff8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8', 'volume_size': 2, 'source_volid': 'a910f8ed-fac2-4209-ad01-55c7ab50d8ae', 'source_volstatus': 'available'} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:24 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 1073741824" returned: 0 in 0.515s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:24 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 Apr 20 17:11:24 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:25 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78" returned: 0 in 0.396s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87987870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c148aeb-1e9a-4f84-956a-f6133ad95bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Creating volume 1c148aeb-1e9a-4f84-956a-f6133ad95bbc {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:25 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340b6f69-8ddc-49f9-97e4-b9b55d5f4441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852d933a-4523-4be2-96fc-b3f3de709f78', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:25 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc 1073741824 Apr 20 17:11:25 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75169b47-53af-4ae1-8dae-a11947e40eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:25 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Volume volume-852d933a-4523-4be2-96fc-b3f3de709f78 (852d933a-4523-4be2-96fc-b3f3de709f78): created successfully Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75169b47-53af-4ae1-8dae-a11947e40eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (a929d504-af36-475a-9336-cf45328cf790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-29fcef3f-8d6a-4353-9a71-e517dc4d7b3c tempest-CreateVolumesFromImageTest-2009399298 None] Created volume successfully. Apr 20 17:11:25 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc 1073741824" returned: 0 in 0.507s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:25 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc Apr 20 17:11:25 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:25 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc" returned: 0 in 0.403s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.681s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757791602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19513785-e106-4413-a49e-164ba9e587c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Creating volume 19513785-e106-4413-a49e-164ba9e587c5 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:26 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e2d13d-6f1c-42b9-b917-9b68d143d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:26 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 1073741824 Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2c4c70-f937-4b69-99a2-faf263cd0b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:26 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:26 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Volume volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc (1c148aeb-1e9a-4f84-956a-f6133ad95bbc): created successfully Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2c4c70-f937-4b69-99a2-faf263cd0b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (90ebe4ea-d0eb-4a61-a3c7-d80b3f54a517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:26 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1f6be15e-ee28-4ebb-b4db-0bab23372bd2 tempest-CreateVolumesFromImageTest-2009399298 None] Created volume successfully. Apr 20 17:11:26 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 1073741824" returned: 0 in 0.490s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:26 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 Apr 20 17:11:26 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:26 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5" returned: 0 in 0.403s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.496s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-170458589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eee0d6a-8486-4d10-acbd-e29385da6b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212dc4b4942744bb9e67b64ec6d0a743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:23Z,use_quota=True,user_id='9e435b0c26a04d07873dc1b2d174ee28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Creating volume 5eee0d6a-8486-4d10-acbd-e29385da6b05 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:26 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf58d1a-fdbd-425e-8d04-37777504e424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19513785-e106-4413-a49e-164ba9e587c5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e886f734-9b7c-4c98-a15d-1da758ecdc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:26 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 1073741824 Apr 20 17:11:26 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:26 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Volume volume-19513785-e106-4413-a49e-164ba9e587c5 (19513785-e106-4413-a49e-164ba9e587c5): created successfully Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e886f734-9b7c-4c98-a15d-1da758ecdc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:26 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (bca527e9-5145-4e83-b7cc-0a393e01df68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:26 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7800e3fd-1fe8-43c1-8e55-90182dc5a6dd tempest-CreateVolumesFromImageTest-2009399298 None] Created volume successfully. Apr 20 17:11:27 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 1073741824" returned: 0 in 0.467s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:27 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 Apr 20 17:11:27 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:27 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05" returned: 0 in 0.399s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.404s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:27 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Cloning volume a910f8ed-fac2-4209-ad01-55c7ab50d8ae to volume 4517e1e8-3e0b-47b1-93e6-64c50f062ff8 Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c656c4cf-d211-4f65-84b3-5fba1fa15677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eee0d6a-8486-4d10-acbd-e29385da6b05', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220c8a42-36ea-415a-96dd-a169e8be13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:27 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Volume volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 (5eee0d6a-8486-4d10-acbd-e29385da6b05): created successfully Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220c8a42-36ea-415a-96dd-a169e8be13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Flow 'volume_create_manager' (cb695181-79cf-48a6-b807-5e8ee95491e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Creating offline snapshot 34f5b310-fa8b-4dc9-ad5f-8249fa6483dd of volume a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:11:27 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b63ac2f4-e3aa-4b1d-b0d6-2786c42e54a2 tempest-CreateVolumesFromImageTest-2009399298 None] Created volume successfully. Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f36edf-4071-4338-b1df-73f00b79cefd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:27 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae Apr 20 17:11:27 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:28 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" returned: 0 in 0.459s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:28 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd 1G Apr 20 17:11:28 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-5eee0d6a-8486-4d10-acbd-e29385da6b05-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-5eee0d6a-8486-4d10-acbd-e29385da6b05-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:28 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd 1G" returned: 0 in 0.499s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:28 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd Apr 20 17:11:28 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-quobyte-5eee0d6a-8486-4d10-acbd-e29385da6b05" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-5eee0d6a-8486-4d10-acbd-e29385da6b05" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0239bc-fcd9-4f3e-8ab2-5af52852d2f6]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:28 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 Apr 20 17:11:28 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:29 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" returned: 0 in 0.434s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:29 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd is being set with open permissions: ugo+rw Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:29 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd Apr 20 17:11:29 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:29 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:29 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05 Apr 20 17:11:29 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:29 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" returned: 0 in 0.392s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:29 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.info Apr 20 17:11:29 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:29 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-5eee0d6a-8486-4d10-acbd-e29385da6b05" returned: 0 in 0.410s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-5eee0d6a-8486-4d10-acbd-e29385da6b05" released by "delete_volume" :: held 0.877s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Created reservations ['0f01e07a-20f9-4e14-9be9-0a1e09275db0', '45189e4a-d79d-4afb-99c0-326f3bd033fa', 'd575e73b-bd97-4689-a44e-4b1150709ed7', '6c653d99-0710-426c-8448-169ac9fe2f85'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:29 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:29 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-19513785-e106-4413-a49e-164ba9e587c5-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-19513785-e106-4413-a49e-164ba9e587c5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-quobyte-19513785-e106-4413-a49e-164ba9e587c5" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-19513785-e106-4413-a49e-164ba9e587c5" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c30e1b-9255-406d-ba64-ecab8e3ee29e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:30 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:30 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:30 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 Apr 20 17:11:30 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:30 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.info" returned: 0 in 0.464s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:30 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.info is being set with open permissions: ugo+rw Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:30 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.info Apr 20 17:11:30 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:30 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.445s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:30 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Deleted volume successfully. Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ecc6812c-4b81-4b64-94db-97eda267110e tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-5eee0d6a-8486-4d10-acbd-e29385da6b05-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:30 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.395s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:30 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5" returned: 0 in 0.499s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:30 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5 Apr 20 17:11:30 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:30 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.info" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Acquiring lock "cinder-quobyte-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Lock "cinder-quobyte-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] snapshot: 34f5b310-fa8b-4dc9-ad5f-8249fa6483dd, volume: 4517e1e8-3e0b-47b1-93e6-64c50f062ff8, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e80fd-5dec-4f59-a03a-071f525aaac4]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:30 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd Apr 20 17:11:30 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:30 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-19513785-e106-4413-a49e-164ba9e587c5" returned: 0 in 0.432s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-19513785-e106-4413-a49e-164ba9e587c5" released by "delete_volume" :: held 0.960s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:30 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Created reservations ['f509fa39-51ed-4f80-9ca4-21d575cb6851', '422d36f2-ac5d-40cb-8d68-efe357d8781f', '378058e4-0ee6-4eaf-9181-748304353bd6', '43ed2d81-b973-45e7-a425-b6094213bcaf'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:31 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:31 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-1c148aeb-1e9a-4f84-956a-f6133ad95bbc-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-1c148aeb-1e9a-4f84-956a-f6133ad95bbc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:31 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" returned: 0 in 0.464s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae84e87-053e-42d9-8d26-e375236ec69b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-quobyte-1c148aeb-1e9a-4f84-956a-f6133ad95bbc" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-1c148aeb-1e9a-4f84-956a-f6133ad95bbc" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda6b9e-a1d1-40cd-a904-df49f6ef0be4]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:31 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae Apr 20 17:11:31 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:31 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc Apr 20 17:11:31 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:31 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.433s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Deleted volume successfully. Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-df52274d-f9cf-424a-9ee1-09a89f7ee18f tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-19513785-e106-4413-a49e-164ba9e587c5-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:31 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" returned: 0 in 0.471s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:31 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 Apr 20 17:11:31 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:31 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc" returned: 0 in 0.476s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:31 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc Apr 20 17:11:31 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:32 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1c148aeb-1e9a-4f84-956a-f6133ad95bbc" returned: 0 in 0.594s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-1c148aeb-1e9a-4f84-956a-f6133ad95bbc" released by "delete_volume" :: held 1.110s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Created reservations ['d6970580-1a05-4710-b9e8-ac087535e1cc', '98332239-6fff-48cc-98fa-6721e14881c0', '3712134f-a07b-4a34-80b0-3360704170ad', 'fa6146c7-2e80-4ca4-86fc-2a98ef6d073f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:32 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:32 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:33 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.854s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:33 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Deleted volume successfully. Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a9e0bc61-1187-42f3-9938-ff6a9c0bd076 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-1c148aeb-1e9a-4f84-956a-f6133ad95bbc-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-852d933a-4523-4be2-96fc-b3f3de709f78-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-852d933a-4523-4be2-96fc-b3f3de709f78-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-quobyte-852d933a-4523-4be2-96fc-b3f3de709f78" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-852d933a-4523-4be2-96fc-b3f3de709f78" acquired by "delete_volume" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1160a1-6c7c-4cef-bb91-da0db47eed3a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:33 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 Apr 20 17:11:33 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:33 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" returned: 0 in 2.122s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cdea36-5f8f-4330-be29-41b444091b08]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:33 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae Apr 20 17:11:33 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:34 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78" returned: 0 in 0.552s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:34 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78 Apr 20 17:11:34 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:34 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" returned: 0 in 0.590s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:11:34 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Converted 1024.00 MB image at 482.19 MB/s Apr 20 17:11:34 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 is being set with open permissions: ugo+rw Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:34 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 Apr 20 17:11:34 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:34 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-852d933a-4523-4be2-96fc-b3f3de709f78" returned: 0 in 0.419s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-852d933a-4523-4be2-96fc-b3f3de709f78" released by "delete_volume" :: held 1.008s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Created reservations ['18515f1b-77ba-4cf3-8c3a-fa441fa83741', '4b3c1c8c-3111-42c9-9a5a-61b05fd4ed2d', 'f84ab2b4-b5d6-4924-a0ea-7506706e7ce5', 'd9a25dd2-9c9c-4ed3-8e4e-a9deebcc8be7'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:34 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:34 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:34 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" returned: 0 in 0.446s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Lock "cinder-quobyte-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" released by "_copy_volume_from_snapshot" :: held 4.147s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Acquiring lock "cinder-quobyte-34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Lock "cinder-quobyte-34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Deleting offline snapshot 34f5b310-fa8b-4dc9-ad5f-8249fa6483dd of volume a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] snapshot_file for this snap is: volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b849f8d5-9da9-4db9-907f-03e3df430f00]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:34 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd Apr 20 17:11:34 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:35 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.429s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:35 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Deleted volume successfully. Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7b5a372c-df47-41a6-921f-0e2686eb9649 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-852d933a-4523-4be2-96fc-b3f3de709f78-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:35 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2c8c5-880d-45b8-be49-98e5889e18b5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:35 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae Apr 20 17:11:35 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-ae470d83-8ac2-4dad-8708-ef35934271d9-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-ae470d83-8ac2-4dad-8708-ef35934271d9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "cinder-quobyte-ae470d83-8ac2-4dad-8708-ef35934271d9" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-ae470d83-8ac2-4dad-8708-ef35934271d9" acquired by "delete_volume" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[958893d3-7792-461b-aa22-fab7fef1c1a4]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:35 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 Apr 20 17:11:35 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:35 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" returned: 0 in 0.478s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:35 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd Apr 20 17:11:35 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:36 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9" returned: 0 in 0.478s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:36 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9 Apr 20 17:11:36 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:36 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" returned: 0 in 0.454s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:36 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd Apr 20 17:11:36 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:36 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-ae470d83-8ac2-4dad-8708-ef35934271d9" returned: 0 in 0.397s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-quobyte-ae470d83-8ac2-4dad-8708-ef35934271d9" released by "delete_volume" :: held 0.899s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Created reservations ['bb6371f2-03b0-4940-aaaf-c7bd75781417', '4b4f3aa9-4f35-4af2-8c09-407b532d8d1a', 'c9e01ac7-201b-4c4a-8b8b-347da8a9a072', '50e49543-847c-49bd-b14c-93ef70dbcc4f'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:36 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae.34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" returned: 0 in 0.397s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Lock "cinder-quobyte-34f5b310-fa8b-4dc9-ad5f-8249fa6483dd" released by "_delete_snapshot" :: held 1.854s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.832s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b59760e-4541-43b3-8c71-77e01d6d7614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8', 'volume_size': 2, 'source_volid': 'a910f8ed-fac2-4209-ad01-55c7ab50d8ae', 'source_volstatus': 'available'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411dd734-bda3-4322-a7f4-09db71c9d9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:36 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:36 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:36 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Volume volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 (4517e1e8-3e0b-47b1-93e6-64c50f062ff8): created successfully Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411dd734-bda3-4322-a7f4-09db71c9d9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Flow 'volume_create_manager' (b017da93-71ff-4733-96c6-9ac9d7e6a80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:36 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3042ae7c-ee2a-40bc-82af-36d5339699b1 tempest-VolumesCloneTest-820440002 None] Created volume successfully. Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Acquiring lock "cinder-4517e1e8-3e0b-47b1-93e6-64c50f062ff8-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Lock "cinder-4517e1e8-3e0b-47b1-93e6-64c50f062ff8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Acquiring lock "cinder-quobyte-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Lock "cinder-quobyte-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:37 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.546s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b116d14f-3c60-459f-9970-92d50d6a30ff]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:37 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Deleted volume successfully. Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-e5f63e0c-76eb-4f33-81e8-b69d13ee5613 tempest-CreateVolumesFromImageTest-2009399298 None] Lock "cinder-ae470d83-8ac2-4dad-8708-ef35934271d9-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:37 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 Apr 20 17:11:37 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:37 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" returned: 0 in 0.501s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:37 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8 Apr 20 17:11:37 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:38 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" returned: 0 in 0.413s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Lock "cinder-quobyte-4517e1e8-3e0b-47b1-93e6-64c50f062ff8" released by "delete_volume" :: held 0.944s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Created reservations ['acdb3e47-a149-452f-919f-2066022142d4', '0f4b0967-2de0-403f-acdd-f874ae55b750', 'de8d8f67-27ad-423a-9c91-48948ed6e6ab', '55463226-afa2-4124-894d-e4fe68d33b56'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:38 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:38 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Acquiring lock "cinder-a910f8ed-fac2-4209-ad01-55c7ab50d8ae-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Lock "cinder-a910f8ed-fac2-4209-ad01-55c7ab50d8ae-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Acquiring lock "cinder-quobyte-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Lock "cinder-quobyte-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" acquired by "delete_volume" :: waited 0.030s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1886dde5-f772-47e0-9d53-024e6e786877]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Flow 'volume_create_manager' (2561ac61-f5f1-45b8-b1c4-ed0e9d45971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedfd8e7-2860-44b8-82b0-1d701deca7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:38 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae Apr 20 17:11:38 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedfd8e7-2860-44b8-82b0-1d701deca7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-932653703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9071ce16-82ad-4d21-b1a0-c6d4316842fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621d38a07c6545548cafdccd5da7117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:38Z,use_quota=True,user_id='f58aebb81c3d4162b7d8103024339bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8585471c-6cc9-4cc0-906e-fa715b69b816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8585471c-6cc9-4cc0-906e-fa715b69b816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870dc1ef-1b74-40a0-aac6-5c778aca7d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870dc1ef-1b74-40a0-aac6-5c778aca7d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9071ce16-82ad-4d21-b1a0-c6d4316842fa', 'volume_name': 'volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210c4cb8-9125-4c0f-a8f5-6b1619bc4b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210c4cb8-9125-4c0f-a8f5-6b1619bc4b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435441f1-cf03-4f53-8482-bebf83b205c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:38 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Volume 9071ce16-82ad-4d21-b1a0-c6d4316842fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa', 'volume_size': 1} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-932653703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9071ce16-82ad-4d21-b1a0-c6d4316842fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621d38a07c6545548cafdccd5da7117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:38Z,use_quota=True,user_id='f58aebb81c3d4162b7d8103024339bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Creating volume 9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:38 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:38 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa 1073741824 Apr 20 17:11:38 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:38 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.459s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:38 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Deleted volume successfully. Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-f2d43bff-6cb9-459c-9aaa-6eb24fe597ea tempest-VolumesCloneTest-820440002 None] Lock "cinder-4517e1e8-3e0b-47b1-93e6-64c50f062ff8-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:38 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" returned: 0 in 0.544s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:38 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae Apr 20 17:11:38 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:38 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa 1073741824" returned: 0 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:39 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa Apr 20 17:11:39 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:39 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" returned: 0 in 0.407s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Lock "cinder-quobyte-a910f8ed-fac2-4209-ad01-55c7ab50d8ae" released by "delete_volume" :: held 0.982s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Created reservations ['62d63d0b-a14e-4388-a042-70f2596d9844', '79bb0a20-cee9-4a92-b538-d9672fe10db2', '5846f82e-1647-45a5-bfec-5aa83b66ede6', '8b58ab9a-946e-4192-8342-c869f565fa71'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:39 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:39 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:39 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa" returned: 0 in 0.458s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435441f1-cf03-4f53-8482-bebf83b205c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e550e41-d51b-46d7-8507-76d516b4598b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:39 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Volume volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa (9071ce16-82ad-4d21-b1a0-c6d4316842fa): created successfully Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e550e41-d51b-46d7-8507-76d516b4598b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Flow 'volume_create_manager' (2561ac61-f5f1-45b8-b1c4-ed0e9d45971a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:39 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4a96ba9f-861d-45e3-8d28-87a7f82f1dc9 tempest-VolumeDependencyTests-39580550 None] Created volume successfully. Apr 20 17:11:39 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.428s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:39 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Deleted volume successfully. Apr 20 17:11:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-46ac906f-76c1-4b97-b9da-f04a993de2d8 tempest-VolumesCloneTest-820440002 None] Lock "cinder-a910f8ed-fac2-4209-ad01-55c7ab50d8ae-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Creating offline snapshot f82dd8d9-9180-460b-8b16-5e5703b08e56 of volume 9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:11:40 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[69176fad-1788-4d08-b7fe-904904f31ffd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:41 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa Apr 20 17:11:41 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:41 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa" returned: 0 in 0.505s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:41 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 1G Apr 20 17:11:41 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:41 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 1G" returned: 0 in 0.533s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:42 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 Apr 20 17:11:42 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Flow 'volume_create_manager' (c1b9e70e-527a-4f30-bee8-8dd0b47bc790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffa4292-bb38-4cd5-ae87-39e1e59d5d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffa4292-bb38-4cd5-ae87-39e1e59d5d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-980785112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29301201-f53f-41fc-8847-a7bc40c41e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec810a6f8ed642e28266707bd210e1c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:42Z,use_quota=True,user_id='6d45368088d44f21a28d60c249f6555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca96d34-c1c7-4e65-9e7f-539aba9bf1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca96d34-c1c7-4e65-9e7f-539aba9bf1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0904718-1460-4201-a8cc-3d7bb1a35ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.image.glance [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Creating Keystone auth plugin from conf {{(pid=82240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 20 17:11:42 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:42 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 is being set with open permissions: ugo+rw Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:42 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 Apr 20 17:11:42 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0904718-1460-4201-a8cc-3d7bb1a35ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29301201-f53f-41fc-8847-a7bc40c41e87', 'volume_name': 'volume-29301201-f53f-41fc-8847-a7bc40c41e87', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3258766b-d31d-4a85-b219-86195ec216ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3258766b-d31d-4a85-b219-86195ec216ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95be9549-8bfa-4969-b671-ea2131660090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:42 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Volume 29301201-f53f-41fc-8847-a7bc40c41e87: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29301201-f53f-41fc-8847-a7bc40c41e87', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Trying to clone 29301201-f53f-41fc-8847-a7bc40c41e87 from image 295802c4-6388-4dc0-a97e-75ff54234992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]). {{(pid=82240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Apr 20 17:11:42 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Image download 20.69 MB at 20.69 MB/s Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[768f7359-9e30-46db-bf01-a6510f71c185]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:42 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD Apr 20 17:11:42 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:42 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56" returned: 0 in 0.455s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:42 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.info Apr 20 17:11:42 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:43 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Temporary image 295802c4-6388-4dc0-a97e-75ff54234992 is fetched for user 6d45368088d44f21a28d60c249f6555d. {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a956ea-1fe9-488a-86c1-ff54de83d881]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:43 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD Apr 20 17:11:43 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:43 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.info" returned: 0 in 0.478s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:43 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.info is being set with open permissions: ugo+rw Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:43 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.info Apr 20 17:11:43 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:43 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:43 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.info" returned: 0 in 0.395s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.147s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-980785112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29301201-f53f-41fc-8847-a7bc40c41e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec810a6f8ed642e28266707bd210e1c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:42Z,use_quota=True,user_id='6d45368088d44f21a28d60c249f6555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Creating volume 29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:43 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:43 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 1073741824 Apr 20 17:11:43 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-10a63353-2938-4f61-9e86-d5676eec195a tempest-VolumeDependencyTests-39580550 None] Create snapshot completed successfully Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Flow 'volume_create_manager' (76dbcf14-ac08-4e57-89df-7cdcc477a2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541cae87-cc3d-48f6-889e-342ebef6772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541cae87-cc3d-48f6-889e-342ebef6772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1743166801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f6b7fc-8340-452e-81d2-e83f794afb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621d38a07c6545548cafdccd5da7117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f82dd8d9-9180-460b-8b16-5e5703b08e56,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:44Z,use_quota=True,user_id='f58aebb81c3d4162b7d8103024339bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf19633b-e0d8-4616-8cc1-afa8d6b132aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf19633b-e0d8-4616-8cc1-afa8d6b132aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dc8d73-c7a8-4212-8d48-f5c2155c43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dc8d73-c7a8-4212-8d48-f5c2155c43a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2f6b7fc-8340-452e-81d2-e83f794afb08', 'volume_name': 'volume-d2f6b7fc-8340-452e-81d2-e83f794afb08', 'volume_size': 1, 'snapshot_id': 'f82dd8d9-9180-460b-8b16-5e5703b08e56'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2672018a-5eff-4525-8bc8-3454926b12a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2672018a-5eff-4525-8bc8-3454926b12a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b017cac3-20e1-471c-b18c-804ed6fd1782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:44 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Volume d2f6b7fc-8340-452e-81d2-e83f794afb08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2f6b7fc-8340-452e-81d2-e83f794afb08', 'volume_size': 1, 'snapshot_id': 'f82dd8d9-9180-460b-8b16-5e5703b08e56'} Apr 20 17:11:44 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 1073741824" returned: 0 in 0.512s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:44 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:44 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:44 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 0 in 0.407s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.433s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-f82dd8d9-9180-460b-8b16-5e5703b08e56-d2f6b7fc-8340-452e-81d2-e83f794afb08" by "_create_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Attempting download of 295802c4-6388-4dc0-a97e-75ff54234992 ((None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}])) to volume 29301201-f53f-41fc-8847-a7bc40c41e87. {{(pid=82240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-f82dd8d9-9180-460b-8b16-5e5703b08e56-d2f6b7fc-8340-452e-81d2-e83f794afb08" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Creating volume d2f6b7fc-8340-452e-81d2-e83f794afb08 from snapshot f82dd8d9-9180-460b-8b16-5e5703b08e56 {{(pid=82240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-d2f6b7fc-8340-452e-81d2-e83f794afb08" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-d2f6b7fc-8340-452e-81d2-e83f794afb08" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] snapshot: f82dd8d9-9180-460b-8b16-5e5703b08e56, volume: d2f6b7fc-8340-452e-81d2-e83f794afb08, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e549e7f-9319-434d-b2b8-c56e9c635225]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_98kpq2ri {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b8323-ef53-4c70-acfa-92de1ea1e2b6]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:44 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_98kpq2ri Apr 20 17:11:44 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:44 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 Apr 20 17:11:44 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:45 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_98kpq2ri" returned: 0 in 0.451s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_98kpq2ri {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:45 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56" returned: 0 in 0.485s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:11:45 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_98kpq2ri Apr 20 17:11:45 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc78503-c832-43fe-868c-e5a40794ea04]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:45 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa Apr 20 17:11:45 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:45 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_98kpq2ri" returned: 1 in 0.449s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_295802c4-6388-4dc0-a97e-75ff54234992_98kpq2ri' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[433191ce-a425-4617-a766-74010348a025]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:45 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD Apr 20 17:11:45 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:45 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa" returned: 0 in 0.458s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:11:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:45 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 Apr 20 17:11:45 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:46 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:46 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] 295802c4-6388-4dc0-a97e-75ff54234992 was qcow2, converting to raw {{(pid=82240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Apr 20 17:11:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:46 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:46 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:47 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 0 in 1.678s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:47 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_295802c4-6388-4dc0-a97e-75ff54234992_egzwbdsydevstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:11:47 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Converted 112.00 MB image at 66.70 MB/s Apr 20 17:11:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:47 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 1G Apr 20 17:11:47 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:48 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08" returned: 0 in 2.176s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a624124f-1892-454e-b963-61c89da36e68]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:48 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa Apr 20 17:11:48 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:48 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 1G" returned: 0 in 0.436s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[77336b3e-2f66-4de2-93be-5a1286b4e5d3]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:48 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:48 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:48 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa" returned: 0 in 0.612s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:11:48 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Converted 1024.00 MB image at 470.22 MB/s Apr 20 17:11:48 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 is being set with open permissions: ugo+rw Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:48 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 Apr 20 17:11:48 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:48 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 0 in 0.473s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:48 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:48 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:49 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08" returned: 0 in 0.411s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-d2f6b7fc-8340-452e-81d2-e83f794afb08" released by "_copy_volume_from_snapshot" :: held 4.207s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-f82dd8d9-9180-460b-8b16-5e5703b08e56-d2f6b7fc-8340-452e-81d2-e83f794afb08" released by "_create_volume_from_snapshot" :: held 4.240s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.266s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b017cac3-20e1-471c-b18c-804ed6fd1782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f6b7fc-8340-452e-81d2-e83f794afb08', 'volume_size': 1, 'snapshot_id': 'f82dd8d9-9180-460b-8b16-5e5703b08e56'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57d303f-99d8-4cf8-8a7c-325b793b21f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:49 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Volume volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 (d2f6b7fc-8340-452e-81d2-e83f794afb08): created successfully Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57d303f-99d8-4cf8-8a7c-325b793b21f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Flow 'volume_create_manager' (76dbcf14-ac08-4e57-89df-7cdcc477a2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-12d32609-3b33-4774-ac7c-4c4052671b90 tempest-VolumeDependencyTests-39580550 None] Created volume successfully. Apr 20 17:11:49 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 1 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Downloaded image 295802c4-6388-4dc0-a97e-75ff54234992 ((None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}])) to volume 29301201-f53f-41fc-8847-a7bc40c41e87 successfully. {{(pid=82240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Temporary image 295802c4-6388-4dc0-a97e-75ff54234992 for user 6d45368088d44f21a28d60c249f6555d is deleted. {{(pid=82240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.volume_utils [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Marking volume 29301201-f53f-41fc-8847-a7bc40c41e87 as bootable. {{(pid=82240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Copying metadata from image 295802c4-6388-4dc0-a97e-75ff54234992 to 29301201-f53f-41fc-8847-a7bc40c41e87. {{(pid=82240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Creating volume glance metadata for volume 29301201-f53f-41fc-8847-a7bc40c41e87 backed by image 295802c4-6388-4dc0-a97e-75ff54234992 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95be9549-8bfa-4969-b671-ea2131660090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29301201-f53f-41fc-8847-a7bc40c41e87', 'volume_size': 1, 'image_id': '295802c4-6388-4dc0-a97e-75ff54234992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/295802c4-6388-4dc0-a97e-75ff54234992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bca7b52d61e4492abc5adcad5c8c1a73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '295802c4-6388-4dc0-a97e-75ff54234992', 'created_at': datetime.datetime(2026, 4, 20, 14, 59, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 14, 59, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/295802c4-6388-4dc0-a97e-75ff54234992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef347428-d562-4937-a5c1-f2475c2dbd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:49 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Volume volume-29301201-f53f-41fc-8847-a7bc40c41e87 (29301201-f53f-41fc-8847-a7bc40c41e87): created successfully Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef347428-d562-4937-a5c1-f2475c2dbd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Flow 'volume_create_manager' (c1b9e70e-527a-4f30-bee8-8dd0b47bc790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7af7c146-86a7-47b4-8c6e-8c33ac83383d tempest-VolumesExtendTest-570773092 None] Created volume successfully. Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-f82dd8d9-9180-460b-8b16-5e5703b08e56-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Lock "cinder-f82dd8d9-9180-460b-8b16-5e5703b08e56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-9071ce16-82ad-4d21-b1a0-c6d4316842fa" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-9071ce16-82ad-4d21-b1a0-c6d4316842fa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-f82dd8d9-9180-460b-8b16-5e5703b08e56" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-f82dd8d9-9180-460b-8b16-5e5703b08e56" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Deleting offline snapshot f82dd8d9-9180-460b-8b16-5e5703b08e56 of volume 9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] snapshot_file for this snap is: volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44263fd-ac45-40c9-8288-b24804e9e419]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:49 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 Apr 20 17:11:49 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e2643d-e359-4b1b-95a6-1f59fdc0d95c]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:49 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:49 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:50 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56" returned: 0 in 0.497s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94eabda-2837-4cd0-9e5e-b4eb87ee018f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:50 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 0 in 0.451s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:50 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa Apr 20 17:11:50 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:50 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:50 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:50 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa" returned: 0 in 0.484s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:50 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:50 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 Apr 20 17:11:50 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 1 in 0.474s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 2G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 2G" returned: 0 in 0.044s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.999s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:50 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-830237c1-4e0c-4da9-aefe-25f39ab73d92 tempest-VolumesExtendTest-570773092 None] Extend volume completed successfully. Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Acquiring lock "cinder-29301201-f53f-41fc-8847-a7bc40c41e87-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Lock "cinder-29301201-f53f-41fc-8847-a7bc40c41e87-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Acquiring lock "cinder-quobyte-29301201-f53f-41fc-8847-a7bc40c41e87" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Lock "cinder-quobyte-29301201-f53f-41fc-8847-a7bc40c41e87" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f17231-878f-4778-b757-b5df5843ed2c]: (4, 'raw') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:51 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:51 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:51 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56" returned: 0 in 0.519s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:51 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56 Apr 20 17:11:51 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:51 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 0 in 0.468s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:51 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:51 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:51 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa.f82dd8d9-9180-460b-8b16-5e5703b08e56" returned: 0 in 0.414s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-f82dd8d9-9180-460b-8b16-5e5703b08e56" released by "_delete_snapshot" :: held 1.969s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-9071ce16-82ad-4d21-b1a0-c6d4316842fa" released by "delete_snapshot" :: held 1.982s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Created reservations ['eea8ce5a-6e2e-4c8c-92fe-f97c34ea3fc7', '157b529a-84bd-4a63-b1a5-536ab094f624', 'cf522f78-2559-4673-a39e-2c2779db4a24', '9b3145b8-aae3-4a4c-b965-b8295e2fb347'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:51 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Delete snapshot completed successfully. Apr 20 17:11:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-026b1988-89ce-4f2d-ba00-cc6ddb69914e tempest-VolumeDependencyTests-39580550 None] Lock "cinder-f82dd8d9-9180-460b-8b16-5e5703b08e56-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:52 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 1 in 0.480s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87' failed. Not Retrying. {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:52 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87 Apr 20 17:11:52 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:52 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-29301201-f53f-41fc-8847-a7bc40c41e87" returned: 0 in 0.408s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Lock "cinder-quobyte-29301201-f53f-41fc-8847-a7bc40c41e87" released by "delete_volume" :: held 1.402s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Created reservations ['f27f56ab-c363-4d1a-8bb1-ab931094c5a3', '1f671589-1577-4288-8148-02fea5f26c53', '76be547f-407b-46cb-b5cb-d5ee62e1aad9', '2e115038-037d-4c8d-b1fb-f7d986448594'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:52 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:52 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-9071ce16-82ad-4d21-b1a0-c6d4316842fa-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-9071ce16-82ad-4d21-b1a0-c6d4316842fa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-9071ce16-82ad-4d21-b1a0-c6d4316842fa" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-9071ce16-82ad-4d21-b1a0-c6d4316842fa" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[af614df1-2b9b-4261-9a8d-fdb504320173]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:52 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa Apr 20 17:11:52 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:52 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.450s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:53 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Deleted volume successfully. Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fb44c539-488e-4da0-8351-eed2b08ddc9f tempest-VolumesExtendTest-570773092 None] Lock "cinder-29301201-f53f-41fc-8847-a7bc40c41e87-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Flow 'volume_create_manager' (e1591c5f-9102-46e1-88e9-978c09992d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b407181b-706e-4057-9ef9-3618167a6105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:53 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b407181b-706e-4057-9ef9-3618167a6105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1613300685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e1f47e-6091-491f-ba21-2998ea67294f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec810a6f8ed642e28266707bd210e1c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:53Z,use_quota=True,user_id='6d45368088d44f21a28d60c249f6555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d059da-1b0f-4dbb-8b59-c5e9d05a948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d059da-1b0f-4dbb-8b59-c5e9d05a948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e409ae1d-a593-4f98-9b80-4dd8b50a8c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e409ae1d-a593-4f98-9b80-4dd8b50a8c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e1f47e-6091-491f-ba21-2998ea67294f', 'volume_name': 'volume-c5e1f47e-6091-491f-ba21-2998ea67294f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d176da-ac3b-405b-8e17-8ed6672592d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d176da-ac3b-405b-8e17-8ed6672592d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ae9ac6-d708-4462-be38-9a2ab4a0b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:53 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Volume c5e1f47e-6091-491f-ba21-2998ea67294f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e1f47e-6091-491f-ba21-2998ea67294f', 'volume_size': 1} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1613300685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e1f47e-6091-491f-ba21-2998ea67294f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec810a6f8ed642e28266707bd210e1c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:53Z,use_quota=True,user_id='6d45368088d44f21a28d60c249f6555d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Creating volume c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:53 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa" returned: 0 in 0.571s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:53 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f 1073741824 Apr 20 17:11:53 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:53 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa Apr 20 17:11:53 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:53 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9071ce16-82ad-4d21-b1a0-c6d4316842fa" returned: 0 in 0.434s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-9071ce16-82ad-4d21-b1a0-c6d4316842fa" released by "delete_volume" :: held 1.041s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Created reservations ['35072297-9da1-4d02-997d-27ae45f4bd16', '7a4e9a95-db2d-459a-843b-88e099591e60', 'a4b0b526-6f71-446d-9bbb-7cc32f8af31e', 'd58a69c5-4e4a-40aa-8ca6-e943e2490547'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:11:53 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f 1073741824" returned: 0 in 0.497s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:54 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f Apr 20 17:11:54 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:54 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:11:54 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:54 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f" returned: 0 in 0.411s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ae9ac6-d708-4462-be38-9a2ab4a0b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e1f47e-6091-491f-ba21-2998ea67294f', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958ae0f9-ffd5-40f4-bfb4-bcbab721615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:54 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Volume volume-c5e1f47e-6091-491f-ba21-2998ea67294f (c5e1f47e-6091-491f-ba21-2998ea67294f): created successfully Apr 20 17:11:54 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958ae0f9-ffd5-40f4-bfb4-bcbab721615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Flow 'volume_create_manager' (e1591c5f-9102-46e1-88e9-978c09992d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.427s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:11:54 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Deleted volume successfully. Apr 20 17:11:54 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-54252c69-500c-45ef-8824-cde28bacb36e tempest-VolumesExtendTest-570773092 None] Created volume successfully. Apr 20 17:11:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fe2b9b30-4798-403d-a428-bb661c60a259 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-9071ce16-82ad-4d21-b1a0-c6d4316842fa-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Flow 'volume_create_manager' (0e564c9a-e714-44a4-acd1-fca732502016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d01ca05-e98e-4483-a370-7f06f609a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d01ca05-e98e-4483-a370-7f06f609a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1496179317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9de04b-2652-4323-925a-594f8bf637b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621d38a07c6545548cafdccd5da7117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:55Z,use_quota=True,user_id='f58aebb81c3d4162b7d8103024339bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6923d96-c405-4d3e-bfdc-74b7e5cb0487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6923d96-c405-4d3e-bfdc-74b7e5cb0487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ca2108-d9a7-4bb6-8456-f5e3621f7e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ca2108-d9a7-4bb6-8456-f5e3621f7e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9de04b-2652-4323-925a-594f8bf637b8', 'volume_name': 'volume-dd9de04b-2652-4323-925a-594f8bf637b8', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b985017-2ef9-4c49-8d5e-01054c981eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b985017-2ef9-4c49-8d5e-01054c981eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e022a7bb-9f5a-43f4-8439-7fb8bd8b8943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:55 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Volume dd9de04b-2652-4323-925a-594f8bf637b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9de04b-2652-4323-925a-594f8bf637b8', 'volume_size': 1} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1496179317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9de04b-2652-4323-925a-594f8bf637b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621d38a07c6545548cafdccd5da7117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:55Z,use_quota=True,user_id='f58aebb81c3d4162b7d8103024339bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Creating volume dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:11:55 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:55 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 1073741824 Apr 20 17:11:55 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:55 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 1073741824" returned: 0 in 0.508s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:55 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 Apr 20 17:11:55 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:56 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8" returned: 0 in 0.402s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.550s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e022a7bb-9f5a-43f4-8439-7fb8bd8b8943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9de04b-2652-4323-925a-594f8bf637b8', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e68a300-eb1b-4b80-948b-4adb970db8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Creating offline snapshot 26682b2a-f765-4475-9116-d0fb18b8b167 of volume c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1223eb14-86f4-466a-ad62-8a326f2f7e42]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:56 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Volume volume-dd9de04b-2652-4323-925a-594f8bf637b8 (dd9de04b-2652-4323-925a-594f8bf637b8): created successfully Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e68a300-eb1b-4b80-948b-4adb970db8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Flow 'volume_create_manager' (0e564c9a-e714-44a4-acd1-fca732502016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:56 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7d75af29-1008-41b2-984b-5d6abe2ce997 tempest-VolumeDependencyTests-39580550 None] Created volume successfully. Apr 20 17:11:56 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f Apr 20 17:11:56 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:56 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f" returned: 0 in 0.485s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:56 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 1G Apr 20 17:11:56 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:57 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 1G" returned: 0 in 0.477s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e1f47e-6091-491f-ba21-2998ea67294f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:57 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e1f47e-6091-491f-ba21-2998ea67294f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 Apr 20 17:11:57 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Flow 'volume_create_manager' (b7398d80-5856-42d1-9652-43facb82a676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f91c512-13bb-4b4e-9eaf-0c81b1f15b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f91c512-13bb-4b4e-9eaf-0c81b1f15b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-654056962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621d38a07c6545548cafdccd5da7117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dd9de04b-2652-4323-925a-594f8bf637b8,status='creating',terminated_at=None,updated_at=2026-04-20T15:11:58Z,use_quota=True,user_id='f58aebb81c3d4162b7d8103024339bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683be8fa-000a-4902-9222-65dfb14e6466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683be8fa-000a-4902-9222-65dfb14e6466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b37d650-3e5a-4532-8a2d-5c159b0060b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b37d650-3e5a-4532-8a2d-5c159b0060b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5', 'volume_name': 'volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5', 'volume_size': 1, 'source_volid': 'dd9de04b-2652-4323-925a-594f8bf637b8', 'source_volstatus': 'available'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a43feb-22ff-4779-b805-828b62bd7574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a43feb-22ff-4779-b805-828b62bd7574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20223149-0634-4138-8cd7-57bedc8b3907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:11:57 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Volume a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5', 'volume_size': 1, 'source_volid': 'dd9de04b-2652-4323-925a-594f8bf637b8', 'source_volstatus': 'available'} Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:57 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e1f47e-6091-491f-ba21-2998ea67294f -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167" returned: 0 in 0.471s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:57 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 is being set with open permissions: ugo+rw Apr 20 17:11:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:57 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 Apr 20 17:11:57 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:58 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167" returned: 0 in 0.390s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:58 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.info Apr 20 17:11:58 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:58 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.info" returned: 0 in 0.423s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:58 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.info is being set with open permissions: ugo+rw Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:58 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.info Apr 20 17:11:58 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:58 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.info" returned: 0 in 0.398s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.273s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:11:58 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Cloning volume dd9de04b-2652-4323-925a-594f8bf637b8 to volume a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 Apr 20 17:11:58 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-07912ada-9296-4810-8f53-da10e2a62213 tempest-VolumesExtendTest-570773092 None] Create snapshot completed successfully Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Creating offline snapshot 9eecd646-af3e-4668-aba1-ddefd737306d of volume dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[47823102-720a-4eb2-9d28-0739e588bf63]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:11:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:59 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 Apr 20 17:11:59 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:59 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8" returned: 0 in 0.457s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:59 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d 1G Apr 20 17:11:59 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:11:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5b51d343-5a18-4b87-91ad-35837d19c8d0 tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:11:59 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 20 17:11:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d 1G" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:11:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9de04b-2652-4323-925a-594f8bf637b8 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:11:59 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9de04b-2652-4323-925a-594f8bf637b8 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d Apr 20 17:11:59 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:00 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9de04b-2652-4323-925a-594f8bf637b8 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d" returned: 0 in 0.408s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:00 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d is being set with open permissions: ugo+rw Apr 20 17:12:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:00 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d Apr 20 17:12:00 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:00 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d" returned: 0 in 0.398s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:00 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.info Apr 20 17:12:00 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:01 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.info" returned: 0 in 0.402s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:01 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.info is being set with open permissions: ugo+rw Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:01 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.info Apr 20 17:12:01 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:01 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.info" returned: 0 in 0.409s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] snapshot: 9eecd646-af3e-4668-aba1-ddefd737306d, volume: a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f54185-a3eb-49e7-8872-40920cf29deb]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:01 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:01 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d Apr 20 17:12:01 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:02 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d" returned: 0 in 0.467s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd9de04b-2652-4323-925a-594f8bf637b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[149824b7-7826-4906-a2f3-8acccba222fa]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:02 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 Apr 20 17:12:02 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:02 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8" returned: 0 in 0.466s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:12:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:02 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 Apr 20 17:12:02 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:04 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" returned: 0 in 1.889s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:04 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76d4d34-e580-4483-89a9-c1677df6c707]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:04 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 Apr 20 17:12:04 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:04 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8" returned: 0 in 0.583s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:04 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:12:04 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Converted 1024.00 MB image at 541.82 MB/s Apr 20 17:12:04 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 is being set with open permissions: ugo+rw Apr 20 17:12:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:05 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 Apr 20 17:12:05 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:05 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" returned: 0 in 0.420s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" released by "_copy_volume_from_snapshot" :: held 3.867s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=151,cinder:SELECT=124,cinder:INSERT=34,cinder:DELETE=13 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-9eecd646-af3e-4668-aba1-ddefd737306d" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-9eecd646-af3e-4668-aba1-ddefd737306d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Deleting offline snapshot 9eecd646-af3e-4668-aba1-ddefd737306d of volume dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] snapshot_file for this snap is: volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad6abe9-0124-4215-9937-c083074f8e09]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:05 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d Apr 20 17:12:05 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:05 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd9de04b-2652-4323-925a-594f8bf637b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f59d80c-ae59-4e0e-a989-1c4a878fbcd3]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:06 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 Apr 20 17:12:06 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:06 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8" returned: 0 in 0.462s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:06 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d Apr 20 17:12:06 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:06 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d" returned: 0 in 0.430s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:06 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d Apr 20 17:12:06 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:07 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8.9eecd646-af3e-4668-aba1-ddefd737306d" returned: 0 in 0.419s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-9eecd646-af3e-4668-aba1-ddefd737306d" released by "_delete_snapshot" :: held 1.844s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=98,cinder:UPDATE=130,cinder:INSERT=44,cinder:DELETE=12 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.382s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5b51d343-5a18-4b87-91ad-35837d19c8d0 tempest-VolumesExtendTest-570773092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.466s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20223149-0634-4138-8cd7-57bedc8b3907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5', 'volume_size': 1, 'source_volid': 'dd9de04b-2652-4323-925a-594f8bf637b8', 'source_volstatus': 'available'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa5a164-b468-4510-b3c0-fe6fa3a77529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[574306f0-518e-407c-a304-b802d32f0633]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5b51d343-5a18-4b87-91ad-35837d19c8d0 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:07 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Volume volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 (a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5): created successfully Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa5a164-b468-4510-b3c0-fe6fa3a77529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Flow 'volume_create_manager' (b7398d80-5856-42d1-9652-43facb82a676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7f3f7bcf-b2a9-47c8-96dc-51e8a0fe0925 tempest-VolumeDependencyTests-39580550 None] Created volume successfully. Apr 20 17:12:07 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f Apr 20 17:12:07 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:07 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5b51d343-5a18-4b87-91ad-35837d19c8d0 tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f" returned: 0 in 0.462s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5b51d343-5a18-4b87-91ad-35837d19c8d0 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 2G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-5b51d343-5a18-4b87-91ad-35837d19c8d0 tempest-VolumesExtendTest-570773092 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 2G" returned: 0 in 0.056s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-5b51d343-5a18-4b87-91ad-35837d19c8d0 tempest-VolumesExtendTest-570773092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.548s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-5b51d343-5a18-4b87-91ad-35837d19c8d0 tempest-VolumesExtendTest-570773092 None] Extend volume completed successfully. Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-dd9de04b-2652-4323-925a-594f8bf637b8-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-dd9de04b-2652-4323-925a-594f8bf637b8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-dd9de04b-2652-4323-925a-594f8bf637b8" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-dd9de04b-2652-4323-925a-594f8bf637b8" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[474dde43-216b-41de-85e9-96c9442d3aeb]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:08 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 Apr 20 17:12:08 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Acquiring lock "cinder-26682b2a-f765-4475-9116-d0fb18b8b167-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Lock "cinder-26682b2a-f765-4475-9116-d0fb18b8b167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Acquiring lock "cinder-quobyte-c5e1f47e-6091-491f-ba21-2998ea67294f" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Lock "cinder-quobyte-c5e1f47e-6091-491f-ba21-2998ea67294f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Acquiring lock "cinder-quobyte-26682b2a-f765-4475-9116-d0fb18b8b167" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Lock "cinder-quobyte-26682b2a-f765-4475-9116-d0fb18b8b167" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Deleting offline snapshot 26682b2a-f765-4475-9116-d0fb18b8b167 of volume c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] snapshot_file for this snap is: volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[614df775-e949-4f43-a591-8fa4bddce2cf]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:08 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:08 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 Apr 20 17:12:08 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:08 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8 Apr 20 17:12:08 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:09 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dd9de04b-2652-4323-925a-594f8bf637b8" returned: 0 in 0.390s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-dd9de04b-2652-4323-925a-594f8bf637b8" released by "delete_volume" :: held 0.900s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:09 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167" returned: 0 in 0.468s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e1f47e-6091-491f-ba21-2998ea67294f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[56003050-a201-4e87-a3a2-7d09cc161c12]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Created reservations ['e38a839d-e458-43fd-b95c-2e50f0ce0fbe', 'ee75909d-e5d7-482c-817f-9dfad253b83f', 'f9dd567e-b7b2-40ed-b9fe-df6233ac3935', '9c325120-a483-4ece-adc3-c65a2887fdcc'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:09 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f Apr 20 17:12:09 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:09 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:09 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[162e336c-1e16-4bd0-a14a-d98cf51f1fc6]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:09 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 Apr 20 17:12:09 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:09 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:09 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 Apr 20 17:12:09 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:09 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.467s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Deleted volume successfully. Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4e95a9e0-18ae-4981-992b-3e48cc557008 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-dd9de04b-2652-4323-925a-594f8bf637b8-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:09 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:09 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5 Apr 20 17:12:09 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:09 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167" returned: 0 in 0.461s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:10 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167 Apr 20 17:12:10 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:10 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" returned: 0 in 0.424s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5" released by "delete_volume" :: held 0.940s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Created reservations ['61727032-5cc7-471d-9011-bee2bad6d717', 'd7e9a6d9-109e-4a89-b629-32ae57cd0925', '05000e94-2bf5-4067-8230-b98485b7fd7e', '9f60847e-c933-40af-97c0-c4ac60b809af'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:10 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:10 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-d2f6b7fc-8340-452e-81d2-e83f794afb08-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-d2f6b7fc-8340-452e-81d2-e83f794afb08-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "cinder-quobyte-d2f6b7fc-8340-452e-81d2-e83f794afb08" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:10 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f.26682b2a-f765-4475-9116-d0fb18b8b167" returned: 0 in 0.417s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-d2f6b7fc-8340-452e-81d2-e83f794afb08" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae954848-0ece-4c65-858d-d3125882408e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Lock "cinder-quobyte-26682b2a-f765-4475-9116-d0fb18b8b167" released by "_delete_snapshot" :: held 1.903s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Lock "cinder-quobyte-c5e1f47e-6091-491f-ba21-2998ea67294f" released by "delete_snapshot" :: held 1.920s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Created reservations ['8ac46e34-8e7b-4064-8f82-905a01a857c2', 'a14ac398-144b-4827-b129-010d7b9b4011', '74aab1ca-101b-44e6-a2f6-ad2212ee7328', 'df3aa89f-5b4a-4b20-b0b4-a7d8d8bee486'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:10 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 Apr 20 17:12:10 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:10 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Delete snapshot completed successfully. Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9c84b0ed-9fc5-4004-8714-01fc0107bd37 tempest-VolumesExtendTest-570773092 None] Lock "cinder-26682b2a-f765-4475-9116-d0fb18b8b167-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Acquiring lock "cinder-c5e1f47e-6091-491f-ba21-2998ea67294f-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Lock "cinder-c5e1f47e-6091-491f-ba21-2998ea67294f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Acquiring lock "cinder-quobyte-c5e1f47e-6091-491f-ba21-2998ea67294f" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Lock "cinder-quobyte-c5e1f47e-6091-491f-ba21-2998ea67294f" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4ec18-9c87-4581-b0d7-4b8e7cddcc20]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:10 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.516s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:10 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Deleted volume successfully. Apr 20 17:12:10 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f Apr 20 17:12:10 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-86249e55-cef6-470c-b76b-90278fc06158 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-a8fc32d6-3399-41c1-9a38-a6d5fdd9cdb5-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:10 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08" returned: 0 in 0.486s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:10 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08 Apr 20 17:12:10 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:11 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f" returned: 0 in 0.454s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:11 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f Apr 20 17:12:11 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:11 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-d2f6b7fc-8340-452e-81d2-e83f794afb08" returned: 0 in 0.426s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-quobyte-d2f6b7fc-8340-452e-81d2-e83f794afb08" released by "delete_volume" :: held 0.936s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Created reservations ['df4c282a-82b4-46d7-a425-8354af2ffbff', 'c19ec41a-cd60-4e49-af8e-463dda0a42b6', '2631707f-3221-47a7-a21c-284ea86f0f97', 'b50fa002-1b50-439a-aaf2-4bd490fe4c42'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:11 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:11 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:11 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-c5e1f47e-6091-491f-ba21-2998ea67294f" returned: 0 in 0.403s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Lock "cinder-quobyte-c5e1f47e-6091-491f-ba21-2998ea67294f" released by "delete_volume" :: held 0.895s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Created reservations ['61170dad-f333-416a-b0c2-78839c259467', 'f9b599de-962d-4a4e-a3c9-8360eca7adfa', '0ee1f695-a330-449c-86b9-50fe3b16aac3', '6ed281d3-1095-4d47-8748-936c774cbf13'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:11 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:11 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:11 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.466s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:11 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Deleted volume successfully. Apr 20 17:12:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8d5521bf-6950-4d16-a7dd-40040e3980d5 tempest-VolumeDependencyTests-39580550 None] Lock "cinder-d2f6b7fc-8340-452e-81d2-e83f794afb08-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:12 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.468s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:12 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:12 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Deleted volume successfully. Apr 20 17:12:12 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9e7734f8-869f-40b3-95df-c7ccffe9f116 tempest-VolumesExtendTest-570773092 None] Lock "cinder-c5e1f47e-6091-491f-ba21-2998ea67294f-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Flow 'volume_create_manager' (0d601186-6789-4a9c-bdf9-a1d3c5059594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22b14ed-6f07-42c8-a2ef-ea56fb68bdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22b14ed-6f07-42c8-a2ef-ea56fb68bdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1039086334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba17c51-8bb2-4026-8544-6a87a8eda066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9889b7e0cc4379bc06a7d8cd7dc172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:14Z,use_quota=True,user_id='463bf2ebdb3d40ed8f1c9b8ef1de32eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd7c9ae-b942-42ce-b971-b3f1c8fe2a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd7c9ae-b942-42ce-b971-b3f1c8fe2a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24535263-4446-4620-a390-2f2c4c387769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24535263-4446-4620-a390-2f2c4c387769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba17c51-8bb2-4026-8544-6a87a8eda066', 'volume_name': 'volume-dba17c51-8bb2-4026-8544-6a87a8eda066', 'volume_size': 2}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce995764-4552-4866-8e03-efb6af10907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce995764-4552-4866-8e03-efb6af10907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba452aa-5e6b-4d8f-8de6-a684f1e4035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:13 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Volume dba17c51-8bb2-4026-8544-6a87a8eda066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba17c51-8bb2-4026-8544-6a87a8eda066', 'volume_size': 2} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1039086334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba17c51-8bb2-4026-8544-6a87a8eda066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9889b7e0cc4379bc06a7d8cd7dc172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:14Z,use_quota=True,user_id='463bf2ebdb3d40ed8f1c9b8ef1de32eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Creating volume dba17c51-8bb2-4026-8544-6a87a8eda066 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:13 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 2147483648 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:13 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 2147483648 Apr 20 17:12:13 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:14 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 2147483648" returned: 0 in 0.492s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:14 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 Apr 20 17:12:14 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:14 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066" returned: 0 in 0.423s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba452aa-5e6b-4d8f-8de6-a684f1e4035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba17c51-8bb2-4026-8544-6a87a8eda066', 'volume_size': 2}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0ee2f2-8e6e-4f07-9b39-45eee8742b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:14 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Volume volume-dba17c51-8bb2-4026-8544-6a87a8eda066 (dba17c51-8bb2-4026-8544-6a87a8eda066): created successfully Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0ee2f2-8e6e-4f07-9b39-45eee8742b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:14 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Flow 'volume_create_manager' (0d601186-6789-4a9c-bdf9-a1d3c5059594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:14 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f7a59883-6b3e-43d4-b95a-68ccc6d7559b tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Created volume successfully. Apr 20 17:12:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:15 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Creating offline snapshot d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c of volume dba17c51-8bb2-4026-8544-6a87a8eda066 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:12:15 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[27166a98-197d-49c7-a08d-caa3badbbd05]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:15 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 Apr 20 17:12:15 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:16 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066" returned: 0 in 0.473s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c 2G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:16 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c 2G Apr 20 17:12:16 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:16 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c 2G" returned: 0 in 0.473s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba17c51-8bb2-4026-8544-6a87a8eda066 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:16 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba17c51-8bb2-4026-8544-6a87a8eda066 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c Apr 20 17:12:16 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:17 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba17c51-8bb2-4026-8544-6a87a8eda066 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c" returned: 0 in 0.430s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:17 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c is being set with open permissions: ugo+rw Apr 20 17:12:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:17 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c Apr 20 17:12:17 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:17 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c" returned: 0 in 0.409s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:17 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.info Apr 20 17:12:17 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:18 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.info" returned: 0 in 0.414s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:18 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.info is being set with open permissions: ugo+rw Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:18 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.info Apr 20 17:12:18 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:18 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.info" returned: 0 in 0.422s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:18 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-72b22dc2-b683-447b-b48a-086083908a39 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Create snapshot completed successfully Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "cinder-d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "cinder-quobyte-dba17c51-8bb2-4026-8544-6a87a8eda066" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-quobyte-dba17c51-8bb2-4026-8544-6a87a8eda066" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "cinder-quobyte-d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-quobyte-d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Deleting offline snapshot d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c of volume dba17c51-8bb2-4026-8544-6a87a8eda066 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] snapshot_file for this snap is: volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a907f75-eab0-4ec1-8589-a9ddbbcae153]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:19 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c Apr 20 17:12:19 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:19 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c" returned: 0 in 0.471s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dba17c51-8bb2-4026-8544-6a87a8eda066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:12:19 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9528ba1f-7cea-4997-b8ff-2b44280a6fec]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:19 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 Apr 20 17:12:19 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:19 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066" returned: 0 in 0.465s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:19 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c Apr 20 17:12:19 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:20 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c" returned: 0 in 0.443s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:20 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c Apr 20 17:12:20 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:20 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066.d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c" returned: 0 in 0.404s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-quobyte-d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c" released by "_delete_snapshot" :: held 1.839s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-quobyte-dba17c51-8bb2-4026-8544-6a87a8eda066" released by "delete_snapshot" :: held 1.850s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:20 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Created reservations ['d106b2f6-7a88-49a0-a9d7-659a1c2d0b58', '4c19dd09-0efe-4d42-810a-d4010b3279fe', '22b511e7-eae2-4337-a1e9-3799eed7da48', '462dd1ae-1902-40f1-ab10-e75fe05ea25a'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Delete snapshot completed successfully. Apr 20 17:12:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-13bcefed-c7a8-484a-b7dd-4d011c39f8ce tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-d268d56d-70ec-4f4b-ac2f-d39ed25ffd5c-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "cinder-dba17c51-8bb2-4026-8544-6a87a8eda066-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-dba17c51-8bb2-4026-8544-6a87a8eda066-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "cinder-quobyte-dba17c51-8bb2-4026-8544-6a87a8eda066" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-quobyte-dba17c51-8bb2-4026-8544-6a87a8eda066" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:21 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cf8bc6-8ac8-4cad-a62a-e306ec04a5db]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:21 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 Apr 20 17:12:21 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:21 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066" returned: 0 in 0.463s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:21 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066 Apr 20 17:12:21 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:22 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-dba17c51-8bb2-4026-8544-6a87a8eda066" returned: 0 in 0.410s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-quobyte-dba17c51-8bb2-4026-8544-6a87a8eda066" released by "delete_volume" :: held 0.909s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Created reservations ['623d349c-c65a-42a3-b0a8-6443855ee69a', 'f312e06a-fbe3-480d-ac5c-22fd079cc7d8', 'a37f8070-478b-45f9-8a3a-ed6e3c219bdb', 'b650e507-5120-4a54-aba0-520dbf8d5266'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:22 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:22 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:22 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.453s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:22 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Deleted volume successfully. Apr 20 17:12:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8854f257-8638-4c31-ab6a-5f67fe6723a1 tempest-VolumesSnapshotNegativeTestJSON-271513487 None] Lock "cinder-dba17c51-8bb2-4026-8544-6a87a8eda066-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (745d1c5c-57df-4a9a-bdd4-ba9df28ff134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e16b60-f4ff-4c0b-a010-a52b1ee5f437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e16b60-f4ff-4c0b-a010-a52b1ee5f437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1769738518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708d7fa4-1e44-4647-9cdf-ec41f5388c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:29Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422fe0f0-9c15-4e64-a984-792175fa4d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422fe0f0-9c15-4e64-a984-792175fa4d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702a8bc7-4ac9-45cc-a3db-f4273da60c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702a8bc7-4ac9-45cc-a3db-f4273da60c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708d7fa4-1e44-4647-9cdf-ec41f5388c3d', 'volume_name': 'volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5532e9d-98fc-47f4-a58e-ece928fcdfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5532e9d-98fc-47f4-a58e-ece928fcdfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839776ea-b000-4815-ba05-edc1de255a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Volume 708d7fa4-1e44-4647-9cdf-ec41f5388c3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d', 'volume_size': 1} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1769738518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708d7fa4-1e44-4647-9cdf-ec41f5388c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:29Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Creating volume 708d7fa4-1e44-4647-9cdf-ec41f5388c3d {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:29 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:29 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d 1073741824 Apr 20 17:12:29 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Flow 'volume_create_manager' (62644f04-f7cb-42ce-81d1-d44655acd991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf16c93-4177-45d8-9fae-1dfb65e8d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf16c93-4177-45d8-9fae-1dfb65e8d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-154119989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7767701c-71cd-4cea-b832-259f036c1d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3153e6716d8c4ae7a9322027a2997cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:29Z,use_quota=True,user_id='f2c2b8971e13437e9f0382dc762e07ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504f0a61-03cc-4873-b7d3-755e83d925be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504f0a61-03cc-4873-b7d3-755e83d925be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaaa9f8-c7a8-49e9-9a7a-87c7ed2e548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaaa9f8-c7a8-49e9-9a7a-87c7ed2e548c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7767701c-71cd-4cea-b832-259f036c1d85', 'volume_name': 'volume-7767701c-71cd-4cea-b832-259f036c1d85', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da2b018-a101-488c-96dc-7442f2858975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da2b018-a101-488c-96dc-7442f2858975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c484630b-e56f-4125-b48c-7f794d51464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Volume 7767701c-71cd-4cea-b832-259f036c1d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7767701c-71cd-4cea-b832-259f036c1d85', 'volume_size': 1} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (0a1fa4d8-00e9-4038-9392-9ab00d1bcd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04059ce-de7e-4491-b1e7-9c0106d5c487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04059ce-de7e-4491-b1e7-9c0106d5c487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-904350165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ef0667-50d3-4346-a2b9-5211b6115867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:29Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4f063c-3396-429b-83b4-84d4cb4523e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4f063c-3396-429b-83b4-84d4cb4523e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bab16bb-ecea-451f-b874-f0ad0813ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bab16bb-ecea-451f-b874-f0ad0813ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ef0667-50d3-4346-a2b9-5211b6115867', 'volume_name': 'volume-e8ef0667-50d3-4346-a2b9-5211b6115867', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3479e40-f080-4798-b1d0-22064355f48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3479e40-f080-4798-b1d0-22064355f48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4155d95-7c11-49b1-bf36-950891378cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume e8ef0667-50d3-4346-a2b9-5211b6115867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ef0667-50d3-4346-a2b9-5211b6115867', 'volume_size': 1} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (346d1e18-99c0-4d98-91ad-c6b6c27ac3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf80d04-8fac-46f1-ace1-dd302fa8b309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf80d04-8fac-46f1-ace1-dd302fa8b309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1558252855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d496fc-7035-4ee6-9740-22ef8c11d969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:29Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e48107-8feb-4741-9a99-d3f811e8bfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e48107-8feb-4741-9a99-d3f811e8bfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabb24c7-315e-43fd-8fee-2cf08b1eb256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabb24c7-315e-43fd-8fee-2cf08b1eb256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d496fc-7035-4ee6-9740-22ef8c11d969', 'volume_name': 'volume-13d496fc-7035-4ee6-9740-22ef8c11d969', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c1d989-bcad-4c87-a2a4-9465dda13f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c1d989-bcad-4c87-a2a4-9465dda13f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2768d0-a31a-455b-830c-b1d8970bb54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Volume 13d496fc-7035-4ee6-9740-22ef8c11d969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d496fc-7035-4ee6-9740-22ef8c11d969', 'volume_size': 1} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (75fefc64-11ed-489f-a035-342020391b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ac9555-3add-43bb-ab0b-bdf3c8ee2ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ac9555-3add-43bb-ab0b-bdf3c8ee2ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1342588974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795f4205-56b0-4a48-a4cf-05846ee62140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:30Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06671c4f-c8bc-4f58-acaf-83ad34476fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06671c4f-c8bc-4f58-acaf-83ad34476fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23ba69f-9bb6-4925-8a20-2a85283e6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23ba69f-9bb6-4925-8a20-2a85283e6741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795f4205-56b0-4a48-a4cf-05846ee62140', 'volume_name': 'volume-795f4205-56b0-4a48-a4cf-05846ee62140', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15ba6e3-ad50-4e2d-9b99-a4fceff9afa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15ba6e3-ad50-4e2d-9b99-a4fceff9afa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e30740-17a5-4dfa-870d-01147ad5b674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Volume 795f4205-56b0-4a48-a4cf-05846ee62140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795f4205-56b0-4a48-a4cf-05846ee62140', 'volume_size': 1} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (f8884267-f9ad-466f-a93a-cfed11cd6afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb3e0b3-3836-4db0-8291-327537fcb71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb3e0b3-3836-4db0-8291-327537fcb71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716552483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865cce81-70fd-45b5-96f5-611e5c769fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:30Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd52a4d-6314-43fa-bdfb-181c3321985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd52a4d-6314-43fa-bdfb-181c3321985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ca84a8-e4f1-4e52-8922-1ead6838e597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ca84a8-e4f1-4e52-8922-1ead6838e597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865cce81-70fd-45b5-96f5-611e5c769fc0', 'volume_name': 'volume-865cce81-70fd-45b5-96f5-611e5c769fc0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908f3596-9e46-4bc1-85cc-c1cdff041fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908f3596-9e46-4bc1-85cc-c1cdff041fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a864b1ef-c091-487e-8e6e-5d09617bacd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:29 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Volume 865cce81-70fd-45b5-96f5-611e5c769fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865cce81-70fd-45b5-96f5-611e5c769fc0', 'volume_size': 1} Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:29 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d 1073741824" returned: 0 in 0.796s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:30 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d Apr 20 17:12:30 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (e0b565f4-6c4c-4980-afcc-a3e1dcc9ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949d84e8-b221-43d5-ba45-73971d82632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949d84e8-b221-43d5-ba45-73971d82632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-910139682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ecbcda-95ad-499d-bdb3-a7ad7c7b0902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:30Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6fa3b1-ed0a-4ee5-ae77-fc220787af2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6fa3b1-ed0a-4ee5-ae77-fc220787af2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cde64fa-e6c5-4b6f-b01c-4951cadc2b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cde64fa-e6c5-4b6f-b01c-4951cadc2b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43ecbcda-95ad-499d-bdb3-a7ad7c7b0902', 'volume_name': 'volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f549cef2-73a3-4830-9cd1-0543388f3586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f549cef2-73a3-4830-9cd1-0543388f3586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (922ec2d1-358a-4491-89b5-1a9efb1bd3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:30 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Volume 43ecbcda-95ad-499d-bdb3-a7ad7c7b0902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902', 'volume_size': 1} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:30 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d" returned: 0 in 0.479s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-154119989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7767701c-71cd-4cea-b832-259f036c1d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3153e6716d8c4ae7a9322027a2997cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:29Z,use_quota=True,user_id='f2c2b8971e13437e9f0382dc762e07ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Creating volume 7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:30 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839776ea-b000-4815-ba05-edc1de255a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:30 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 1073741824 Apr 20 17:12:30 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27769fc-6e19-4593-a877-45ae9b977516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:30 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Volume volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d (708d7fa4-1e44-4647-9cdf-ec41f5388c3d): created successfully Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27769fc-6e19-4593-a877-45ae9b977516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:30 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (745d1c5c-57df-4a9a-bdd4-ba9df28ff134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:30 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-db362d40-4481-4c40-b883-e85e2d83c578 tempest-CreateVolumesFromImageTest-49583856 None] Created volume successfully. Apr 20 17:12:31 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 1073741824" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:31 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 Apr 20 17:12:31 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:31 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85" returned: 0 in 0.443s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-904350165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ef0667-50d3-4346-a2b9-5211b6115867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:29Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Creating volume e8ef0667-50d3-4346-a2b9-5211b6115867 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:31 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c484630b-e56f-4125-b48c-7f794d51464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7767701c-71cd-4cea-b832-259f036c1d85', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3994e8c-2880-45ea-a299-1592cc602bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:31 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 1073741824 Apr 20 17:12:31 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:31 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Volume volume-7767701c-71cd-4cea-b832-259f036c1d85 (7767701c-71cd-4cea-b832-259f036c1d85): created successfully Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3994e8c-2880-45ea-a299-1592cc602bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:31 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Flow 'volume_create_manager' (62644f04-f7cb-42ce-81d1-d44655acd991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:31 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-e958fa51-2796-4567-8eeb-bd93345c6cad tempest-VolumeDependencyTests-600852957 None] Created volume successfully. Apr 20 17:12:32 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 1073741824" returned: 0 in 0.508s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:32 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 Apr 20 17:12:32 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:32 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1558252855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d496fc-7035-4ee6-9740-22ef8c11d969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:29Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Creating volume 13d496fc-7035-4ee6-9740-22ef8c11d969 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:32 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4155d95-7c11-49b1-bf36-950891378cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ef0667-50d3-4346-a2b9-5211b6115867', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:32 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 1073741824 Apr 20 17:12:32 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3315884-31d6-465b-ab77-c2e4271642e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:32 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume volume-e8ef0667-50d3-4346-a2b9-5211b6115867 (e8ef0667-50d3-4346-a2b9-5211b6115867): created successfully Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3315884-31d6-465b-ab77-c2e4271642e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (0a1fa4d8-00e9-4038-9392-9ab00d1bcd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:32 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0e4d076e-b18e-4c6e-ace1-88b944d54edc tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created volume successfully. Apr 20 17:12:32 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:33 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 1073741824" returned: 0 in 0.548s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:33 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 Apr 20 17:12:33 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:33 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969" returned: 0 in 0.441s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.816s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1342588974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795f4205-56b0-4a48-a4cf-05846ee62140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:30Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Creating volume 795f4205-56b0-4a48-a4cf-05846ee62140 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:33 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2768d0-a31a-455b-830c-b1d8970bb54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d496fc-7035-4ee6-9740-22ef8c11d969', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19c4ea1-2469-40fc-8707-687cd5addc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:33 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 1073741824 Apr 20 17:12:33 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:33 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Volume volume-13d496fc-7035-4ee6-9740-22ef8c11d969 (13d496fc-7035-4ee6-9740-22ef8c11d969): created successfully Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19c4ea1-2469-40fc-8707-687cd5addc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (346d1e18-99c0-4d98-91ad-c6b6c27ac3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:33 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7358ef85-e0ee-4b91-84d6-7ac330e6fba0 tempest-CreateVolumesFromImageTest-49583856 None] Created volume successfully. Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (b09ef89a-c669-4968-b400-f53d310996d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb38dfcb-7eb7-4623-b29b-defd71da2ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb38dfcb-7eb7-4623-b29b-defd71da2ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121686851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc54fa4-6409-427f-965b-65fc8768dbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:34Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00fcb41-24c8-4ff1-964d-fef7aa027739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00fcb41-24c8-4ff1-964d-fef7aa027739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742256d5-1cb3-4ace-a366-1c60e4dde408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742256d5-1cb3-4ace-a366-1c60e4dde408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc54fa4-6409-427f-965b-65fc8768dbcc', 'volume_name': 'volume-2dc54fa4-6409-427f-965b-65fc8768dbcc', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094ad9bc-eec6-43de-9a2c-3e4ec5a9092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094ad9bc-eec6-43de-9a2c-3e4ec5a9092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddd9ad7-4c08-40e2-9c20-2e80fb3ca916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:33 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume 2dc54fa4-6409-427f-965b-65fc8768dbcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc54fa4-6409-427f-965b-65fc8768dbcc', 'volume_size': 1} Apr 20 17:12:33 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (0818ec01-1376-4d27-a58f-5b7cc94e15d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956b07d5-25ec-4e50-972d-f8be9d94e9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956b07d5-25ec-4e50-972d-f8be9d94e9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1635590422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74883fdf-0d45-498c-a7bd-4dbeb32926b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:34Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81c20e1-a34f-4a1f-bdd0-fb2aa29e05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81c20e1-a34f-4a1f-bdd0-fb2aa29e05ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ead249f-d047-496e-a12f-749397ce9b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ead249f-d047-496e-a12f-749397ce9b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74883fdf-0d45-498c-a7bd-4dbeb32926b2', 'volume_name': 'volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd781a39-a894-42e0-9ad1-9d6fff56ac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd781a39-a894-42e0-9ad1-9d6fff56ac59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd4643f-f42e-4d66-90e8-91f7b138b85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume 74883fdf-0d45-498c-a7bd-4dbeb32926b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2', 'volume_size': 1} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:34 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 1073741824" returned: 0 in 0.833s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:34 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 Apr 20 17:12:34 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (cd1b362f-317c-4aa8-806d-744bef3cbec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b54e72-31f9-4a03-973c-4bc2293e1679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b54e72-31f9-4a03-973c-4bc2293e1679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399657131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf46b165-020a-4fb9-87a1-fd36db05e7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:35Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e174c93-d8e0-43fe-85cc-2aa7a88fd2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e174c93-d8e0-43fe-85cc-2aa7a88fd2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c56b76-98b4-4fbe-be37-f7f0a0c1b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c56b76-98b4-4fbe-be37-f7f0a0c1b58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf46b165-020a-4fb9-87a1-fd36db05e7a5', 'volume_name': 'volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f85597f-3804-4bd3-ab86-18ee33e63a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f85597f-3804-4bd3-ab86-18ee33e63a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a583db6-3a85-49e7-b732-905077a49847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume cf46b165-020a-4fb9-87a1-fd36db05e7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5', 'volume_size': 1} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:34 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140" returned: 0 in 0.489s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.915s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716552483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865cce81-70fd-45b5-96f5-611e5c769fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:30Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Creating volume 865cce81-70fd-45b5-96f5-611e5c769fc0 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:34 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:34 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 1073741824 Apr 20 17:12:34 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e30740-17a5-4dfa-870d-01147ad5b674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795f4205-56b0-4a48-a4cf-05846ee62140', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f22af25-ac17-4777-bd1c-c29f2fa774f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Volume volume-795f4205-56b0-4a48-a4cf-05846ee62140 (795f4205-56b0-4a48-a4cf-05846ee62140): created successfully Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f22af25-ac17-4777-bd1c-c29f2fa774f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (75fefc64-11ed-489f-a035-342020391b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (9e31a437-e9b8-4851-8a2c-cd3a3fba0aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d292c0c-1866-47c2-a34c-0a900c26361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d292c0c-1866-47c2-a34c-0a900c26361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594374187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d24075-75b5-4f65-9232-177fe818f104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:35Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ad88a7-55a6-4202-97bb-b2e72343f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ad88a7-55a6-4202-97bb-b2e72343f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df39945-7231-444c-90ba-1e1c6647b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df39945-7231-444c-90ba-1e1c6647b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d24075-75b5-4f65-9232-177fe818f104', 'volume_name': 'volume-99d24075-75b5-4f65-9232-177fe818f104', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa3d9b-d72b-42da-a400-5e3487a6ebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa3d9b-d72b-42da-a400-5e3487a6ebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb7b5c0-aaea-4dba-ba42-de4f3fc6532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:34 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume 99d24075-75b5-4f65-9232-177fe818f104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d24075-75b5-4f65-9232-177fe818f104', 'volume_size': 1} Apr 20 17:12:34 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:34 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-01df4c46-1545-47c5-967b-4ab1b477bf94 tempest-CreateVolumesFromImageTest-49583856 None] Created volume successfully. Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (73bf7ab7-097d-49c7-a0db-71faa863e6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446e2d78-fadc-4bd1-af28-56e3bca625a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446e2d78-fadc-4bd1-af28-56e3bca625a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985041463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85556df9-5c35-4134-9ba3-385d23e59199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:35Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5be1283-5a17-4fb3-b0d7-a2efbb6f0900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5be1283-5a17-4fb3-b0d7-a2efbb6f0900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a42035c-6768-4b4f-91e4-f05111202e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a42035c-6768-4b4f-91e4-f05111202e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85556df9-5c35-4134-9ba3-385d23e59199', 'volume_name': 'volume-85556df9-5c35-4134-9ba3-385d23e59199', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a9d85a-3626-4313-a46c-87e56e957034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a9d85a-3626-4313-a46c-87e56e957034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dd1256-789f-434f-acf5-d92e910b86b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:35 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume 85556df9-5c35-4134-9ba3-385d23e59199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85556df9-5c35-4134-9ba3-385d23e59199', 'volume_size': 1} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:35 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 1073741824" returned: 0 in 0.618s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:35 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 Apr 20 17:12:35 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:35 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0" returned: 0 in 0.420s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.720s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-910139682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ecbcda-95ad-499d-bdb3-a7ad7c7b0902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b090010c5034c449f3cc68109a456d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:30Z,use_quota=True,user_id='922bb31c582a43eb91251139549ed4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Creating volume 43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:35 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a864b1ef-c091-487e-8e6e-5d09617bacd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865cce81-70fd-45b5-96f5-611e5c769fc0', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a905e1fc-13b4-4177-9ffd-f2a48b10f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:35 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 1073741824 Apr 20 17:12:35 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:35 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Volume volume-865cce81-70fd-45b5-96f5-611e5c769fc0 (865cce81-70fd-45b5-96f5-611e5c769fc0): created successfully Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a905e1fc-13b4-4177-9ffd-f2a48b10f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:35 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (f8884267-f9ad-466f-a93a-cfed11cd6afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:35 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9bbd67fa-3860-42ba-8122-1bd5d30f9afd tempest-CreateVolumesFromImageTest-49583856 None] Created volume successfully. Apr 20 17:12:36 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 1073741824" returned: 0 in 0.484s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:36 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 Apr 20 17:12:36 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:36 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902" returned: 0 in 0.489s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.256s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (922ec2d1-358a-4491-89b5-1a9efb1bd3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b33d5ec-6804-4c76-8663-885eea7536c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Creating offline snapshot 5653cb6c-672e-4c51-93b6-633d67eea827 of volume 7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:12:36 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Volume volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 (43ecbcda-95ad-499d-bdb3-a7ad7c7b0902): created successfully Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b33d5ec-6804-4c76-8663-885eea7536c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Flow 'volume_create_manager' (e0b565f4-6c4c-4980-afcc-a3e1dcc9ea14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ca9e6d-5131-48ca-8e26-d080fa858b23]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:36 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:37 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-928d3923-43c3-4e77-9a26-6fed580938c1 tempest-CreateVolumesFromImageTest-49583856 None] Created volume successfully. Apr 20 17:12:37 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 Apr 20 17:12:37 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:37 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85" returned: 0 in 0.539s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:37 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 1G Apr 20 17:12:37 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-quobyte-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:37 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:37 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b7e9a-fd61-4f03-bd42-b5686a28de92]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:37 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:37 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 Apr 20 17:12:37 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:38 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 1G" returned: 0 in 0.587s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7767701c-71cd-4cea-b832-259f036c1d85 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:38 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7767701c-71cd-4cea-b832-259f036c1d85 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 Apr 20 17:12:38 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:38 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902" returned: 0 in 0.571s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:38 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902 Apr 20 17:12:38 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:38 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7767701c-71cd-4cea-b832-259f036c1d85 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:38 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 is being set with open permissions: ugo+rw Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:38 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 Apr 20 17:12:38 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:38 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902" returned: 0 in 0.450s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902" released by "delete_volume" :: held 1.058s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Created reservations ['541602b9-94e7-4d2d-9c4a-1dccb38e248b', '4f8d3537-9a32-4f3d-aad9-54bcde9b5e9c', '20e3ded3-bf7a-492b-9f09-43561679d2c8', '85089576-ee7e-4b0e-a493-bd52ba99916c'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:38 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:38 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:38 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:39 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827" returned: 0 in 0.468s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:39 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.info Apr 20 17:12:39 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:39 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.496s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:39 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Deleted volume successfully. Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-9ae482c0-cd79-4bf0-b764-539e806d402c tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-43ecbcda-95ad-499d-bdb3-a7ad7c7b0902-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:39 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.info" returned: 0 in 0.445s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:39 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.info is being set with open permissions: ugo+rw Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:39 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.info Apr 20 17:12:39 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-865cce81-70fd-45b5-96f5-611e5c769fc0-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-865cce81-70fd-45b5-96f5-611e5c769fc0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:39 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-quobyte-865cce81-70fd-45b5-96f5-611e5c769fc0" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-865cce81-70fd-45b5-96f5-611e5c769fc0" acquired by "delete_volume" :: waited 0.019s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b2e83c-52a3-44cc-8ec9-093b88475d66]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:40 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.info" returned: 0 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.140s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121686851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc54fa4-6409-427f-965b-65fc8768dbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:34Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Creating volume 2dc54fa4-6409-427f-965b-65fc8768dbcc {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:40 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:40 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:40 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:40 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc 1073741824 Apr 20 17:12:40 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:40 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c84d4b76-8606-4d8d-ba2b-c8777e0f93cf tempest-VolumeDependencyTests-600852957 None] Create snapshot completed successfully Apr 20 17:12:40 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0" returned: 0 in 0.548s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:40 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc 1073741824" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:40 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0 Apr 20 17:12:40 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:40 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:40 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc Apr 20 17:12:40 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:41 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc" returned: 0 in 0.497s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.897s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1635590422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74883fdf-0d45-498c-a7bd-4dbeb32926b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:34Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Creating volume 74883fdf-0d45-498c-a7bd-4dbeb32926b2 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:41 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:41 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 1073741824 Apr 20 17:12:41 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddd9ad7-4c08-40e2-9c20-2e80fb3ca916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc54fa4-6409-427f-965b-65fc8768dbcc', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7746f83-3232-4d59-b8ec-e2dbca0d1eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:41 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume volume-2dc54fa4-6409-427f-965b-65fc8768dbcc (2dc54fa4-6409-427f-965b-65fc8768dbcc): created successfully Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7746f83-3232-4d59-b8ec-e2dbca0d1eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (b09ef89a-c669-4968-b400-f53d310996d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:41 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-865cce81-70fd-45b5-96f5-611e5c769fc0" returned: 0 in 0.646s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-865cce81-70fd-45b5-96f5-611e5c769fc0" released by "delete_volume" :: held 1.224s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:41 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-bb8c09e7-ba34-4da7-888f-1e3eb772ac8b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created volume successfully. Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Created reservations ['7c830269-be39-4817-a44d-23f1e3d9f27a', 'c9e9840d-2e7e-4dfa-a8cc-70e8b23b7bdd', '55f6a30c-21f5-4f83-bd18-bf6a2dad9ead', '47a4c790-fa84-4e14-903f-17a56bbb986e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:41 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:41 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Flow 'volume_create_manager' (d501fc02-56b9-40ab-a216-f87dcf8063bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535745d4-78aa-4886-a2c8-9f6b8aca4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535745d4-78aa-4886-a2c8-9f6b8aca4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1307526595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4f3886-6c5f-4605-ba21-7ec8086bbaa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3153e6716d8c4ae7a9322027a2997cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5653cb6c-672e-4c51-93b6-633d67eea827,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:41Z,use_quota=True,user_id='f2c2b8971e13437e9f0382dc762e07ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8285b39e-e290-4a1a-ba61-f2a1c8c8c48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8285b39e-e290-4a1a-ba61-f2a1c8c8c48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eec2d81-9750-446c-8199-87800429baf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eec2d81-9750-446c-8199-87800429baf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d4f3886-6c5f-4605-ba21-7ec8086bbaa9', 'volume_name': 'volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9', 'volume_size': 1, 'snapshot_id': '5653cb6c-672e-4c51-93b6-633d67eea827'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1610ccd4-beb6-4531-b673-87c3cec44d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1610ccd4-beb6-4531-b673-87c3cec44d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc7b5b3-b60e-420d-8982-9ed16f723de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:41 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Volume 9d4f3886-6c5f-4605-ba21-7ec8086bbaa9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9', 'volume_size': 1, 'snapshot_id': '5653cb6c-672e-4c51-93b6-633d67eea827'} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:41 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 1073741824" returned: 0 in 0.681s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:41 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 Apr 20 17:12:41 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:41 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.606s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:41 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Deleted volume successfully. Apr 20 17:12:41 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b1bd11ea-220f-4faa-8b08-d912248bbc16 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-865cce81-70fd-45b5-96f5-611e5c769fc0-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-795f4205-56b0-4a48-a4cf-05846ee62140-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-795f4205-56b0-4a48-a4cf-05846ee62140-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-quobyte-795f4205-56b0-4a48-a4cf-05846ee62140" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-795f4205-56b0-4a48-a4cf-05846ee62140" acquired by "delete_volume" :: waited 0.021s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec1ec63-81cc-49a7-9558-36c997ae3525]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:42 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2" returned: 0 in 0.515s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.506s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399657131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf46b165-020a-4fb9-87a1-fd36db05e7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:35Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Creating volume cf46b165-020a-4fb9-87a1-fd36db05e7a5 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:42 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:42 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 Apr 20 17:12:42 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd4643f-f42e-4d66-90e8-91f7b138b85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726924ab-58f3-46c7-897c-30d27775c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:42 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 1073741824 Apr 20 17:12:42 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:42 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 (74883fdf-0d45-498c-a7bd-4dbeb32926b2): created successfully Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726924ab-58f3-46c7-897c-30d27775c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (0818ec01-1376-4d27-a58f-5b7cc94e15d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:42 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-41e2bcd0-22b2-4443-9225-ab6d8aac76da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created volume successfully. Apr 20 17:12:42 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140" returned: 0 in 0.651s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:42 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140 Apr 20 17:12:42 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:42 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 1073741824" returned: 0 in 0.611s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:42 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:43 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 Apr 20 17:12:43 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:43 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-795f4205-56b0-4a48-a4cf-05846ee62140" returned: 0 in 0.529s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-795f4205-56b0-4a48-a4cf-05846ee62140" released by "delete_volume" :: held 1.211s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:43 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5" returned: 0 in 0.490s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.493s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594374187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d24075-75b5-4f65-9232-177fe818f104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:35Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Creating volume 99d24075-75b5-4f65-9232-177fe818f104 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:43 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Created reservations ['3bf122e0-c487-42ab-ad0e-04775e925c18', '6813fcaf-ee11-4ff7-ae0d-77409e172785', '7280d93d-c212-424a-a59f-8094334b1a28', '74a5b3df-c774-4f5d-98ae-7faab1c3b32e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:43 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 1073741824 Apr 20 17:12:43 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a583db6-3a85-49e7-b732-905077a49847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30d2b4a-9e38-4d5d-b1f3-056bcae1c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:43 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 (cf46b165-020a-4fb9-87a1-fd36db05e7a5): created successfully Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30d2b4a-9e38-4d5d-b1f3-056bcae1c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (cd1b362f-317c-4aa8-806d-744bef3cbec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:43 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-60c456e5-bb0b-4ad6-8ebb-bb97265b5301 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created volume successfully. Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:43 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:43 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:43 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:44 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 1073741824" returned: 0 in 0.603s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:44 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.548s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:44 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Deleted volume successfully. Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ad324a70-00f1-495a-8626-89e1bc527c38 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-795f4205-56b0-4a48-a4cf-05846ee62140-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:44 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 Apr 20 17:12:44 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-13d496fc-7035-4ee6-9740-22ef8c11d969-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-13d496fc-7035-4ee6-9740-22ef8c11d969-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-quobyte-13d496fc-7035-4ee6-9740-22ef8c11d969" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-13d496fc-7035-4ee6-9740-22ef8c11d969" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b3c18-d768-47a1-b202-b8c57a206a3b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:44 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 Apr 20 17:12:44 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:44 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104" returned: 0 in 0.645s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.504s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985041463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85556df9-5c35-4134-9ba3-385d23e59199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550e7b5b9f4d43e3b72a924a4756f274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:35Z,use_quota=True,user_id='4f160c4459ea42aa928e3db5cb78b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Creating volume 85556df9-5c35-4134-9ba3-385d23e59199 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:44 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:44 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 1073741824 Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb7b5c0-aaea-4dba-ba42-de4f3fc6532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d24075-75b5-4f65-9232-177fe818f104', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:44 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7fb7de-1934-4daa-911e-80fc76863a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:44 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume volume-99d24075-75b5-4f65-9232-177fe818f104 (99d24075-75b5-4f65-9232-177fe818f104): created successfully Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7fb7de-1934-4daa-911e-80fc76863a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:44 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (9e31a437-e9b8-4851-8a2c-cd3a3fba0aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:44 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b0ca4922-0aea-4140-b8f3-7a916ff28257 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created volume successfully. Apr 20 17:12:45 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969" returned: 0 in 0.723s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:45 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969 Apr 20 17:12:45 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Flow 'volume_create_manager' (ec670689-4e10-4a42-b544-9e96417f5978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b64fcb-8178-4ae1-b81d-2f57a2ebed38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b64fcb-8178-4ae1-b81d-2f57a2ebed38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-509219129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689e0173-e9f7-4557-9430-fb7089f1857d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aba5b1afc2c401ca3c45e11fa757983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:45Z,use_quota=True,user_id='cfc650150de34b74bdd05f9b1d3dcc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d0b081-1e70-42c9-a7f3-f3bb7b1147f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d0b081-1e70-42c9-a7f3-f3bb7b1147f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482e4e53-c5a7-4d1f-a90c-447eec3e3d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482e4e53-c5a7-4d1f-a90c-447eec3e3d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689e0173-e9f7-4557-9430-fb7089f1857d', 'volume_name': 'volume-689e0173-e9f7-4557-9430-fb7089f1857d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:45 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3616b52-7b58-4aed-805c-c5f2f8fea595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3616b52-7b58-4aed-805c-c5f2f8fea595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2249900a-0a22-4e17-926e-c873686fe020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:45 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Volume 689e0173-e9f7-4557-9430-fb7089f1857d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689e0173-e9f7-4557-9430-fb7089f1857d', 'volume_size': 1} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 1073741824" returned: 0 in 0.579s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:45 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 Apr 20 17:12:45 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:45 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-13d496fc-7035-4ee6-9740-22ef8c11d969" returned: 0 in 0.495s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-13d496fc-7035-4ee6-9740-22ef8c11d969" released by "delete_volume" :: held 1.245s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Created reservations ['318ee273-feef-40e8-93e8-baa2e6dbb3d9', '8673616d-cbe1-4fd9-9055-60f1b311e461', 'ee74e4c8-ecbf-43c8-be1e-cdf2773892c9', '5940185a-a3ba-4f2d-933d-5a3eb56834f5'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:45 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:45 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:45 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199" returned: 0 in 0.438s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.354s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-5653cb6c-672e-4c51-93b6-633d67eea827-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" by "_create_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dd1256-789f-434f-acf5-d92e910b86b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85556df9-5c35-4134-9ba3-385d23e59199', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edce8957-a333-46b9-ab7c-05f81be06fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-5653cb6c-672e-4c51-93b6-633d67eea827-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Creating volume 9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 from snapshot 5653cb6c-672e-4c51-93b6-633d67eea827 {{(pid=82240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] snapshot: 5653cb6c-672e-4c51-93b6-633d67eea827, volume: 9d4f3886-6c5f-4605-ba21-7ec8086bbaa9, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:12:45 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Volume volume-85556df9-5c35-4134-9ba3-385d23e59199 (85556df9-5c35-4134-9ba3-385d23e59199): created successfully Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edce8957-a333-46b9-ab7c-05f81be06fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Flow 'volume_create_manager' (73bf7ab7-097d-49c7-a0db-71faa863e6a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:45 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ac873cb5-6655-4f8a-b462-dfe3dcec1667 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created volume successfully. Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[952ac264-fb99-4c41-ae3f-e4e01c2b7c13]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-85556df9-5c35-4134-9ba3-385d23e59199-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:45 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-85556df9-5c35-4134-9ba3-385d23e59199-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:45 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 Apr 20 17:12:46 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-quobyte-85556df9-5c35-4134-9ba3-385d23e59199" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-85556df9-5c35-4134-9ba3-385d23e59199" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f150ba-923a-48a7-819a-042569d33852]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:46 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 Apr 20 17:12:46 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:46 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.452s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:46 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Deleted volume successfully. Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-bc1caa14-218c-4e40-8353-65681bec6711 tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-13d496fc-7035-4ee6-9740-22ef8c11d969-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:46 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827" returned: 0 in 0.542s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7767701c-71cd-4cea-b832-259f036c1d85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d81ff9-9842-47fc-b7e6-0ed2777dd8bd]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-708d7fa4-1e44-4647-9cdf-ec41f5388c3d-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-708d7fa4-1e44-4647-9cdf-ec41f5388c3d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:46 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199" returned: 0 in 0.509s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:46 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 Apr 20 17:12:46 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:46 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199 Apr 20 17:12:46 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "cinder-quobyte-708d7fa4-1e44-4647-9cdf-ec41f5388c3d" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-708d7fa4-1e44-4647-9cdf-ec41f5388c3d" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff3d4a-7b03-44c8-9ce9-9855a9420aec]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:46 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d Apr 20 17:12:46 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:46 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:46 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-85556df9-5c35-4134-9ba3-385d23e59199" returned: 0 in 0.435s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:46 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 Apr 20 17:12:46 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:46 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-85556df9-5c35-4134-9ba3-385d23e59199" released by "delete_volume" :: held 0.966s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created reservations ['f79344c8-33a0-4a1a-ae56-2e9ffad47e86', '2ba91afb-5f1d-4cbf-97f2-017cf7709181', 'afa03333-2504-4c14-b043-8ed2307e76fa', '127cb0c7-7e56-4ecc-8463-65ae05a2a79c'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:47 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:47 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-99d24075-75b5-4f65-9232-177fe818f104-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-99d24075-75b5-4f65-9232-177fe818f104-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-quobyte-99d24075-75b5-4f65-9232-177fe818f104" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-99d24075-75b5-4f65-9232-177fe818f104" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:47 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d" returned: 0 in 0.539s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fac5ee-cf8d-495d-a3a3-cddfd971149f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:47 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:47 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d Apr 20 17:12:47 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:47 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 Apr 20 17:12:47 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:48 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104" returned: 0 in 0.968s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:48 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 1.105s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:48 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Deleted volume successfully. Apr 20 17:12:48 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104 Apr 20 17:12:48 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-8ef74289-e6bc-49be-b622-695275ad56dd tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-85556df9-5c35-4134-9ba3-385d23e59199-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:48 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-708d7fa4-1e44-4647-9cdf-ec41f5388c3d" returned: 0 in 1.079s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-quobyte-708d7fa4-1e44-4647-9cdf-ec41f5388c3d" released by "delete_volume" :: held 1.642s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Created reservations ['fb771511-9593-4494-bd4f-900947d3b5d7', '8aa02129-9ade-4e39-8665-9a9daf3a5c2e', '158569ef-f857-40cb-87a3-8d41cf49da90', 'ccb84e54-4072-4ea3-bc24-ad00ef2b8049'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:48 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:48 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:48 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-99d24075-75b5-4f65-9232-177fe818f104" returned: 0 in 0.807s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:48 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-99d24075-75b5-4f65-9232-177fe818f104" released by "delete_volume" :: held 1.816s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created reservations ['914110c4-f323-45f1-ba5f-b232fef36d29', 'd49969b3-902c-4508-8edc-662c31df67b4', 'd93c928f-cc64-484f-9b36-840abe5a2f5d', '46f91654-e849-419c-9fdb-2730e31c5538'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:49 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:49 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:49 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" returned: 0 in 2.418s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[df308c62-f6e1-4d8f-a83f-92c3f41c54ae]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-cf46b165-020a-4fb9-87a1-fd36db05e7a5-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-cf46b165-020a-4fb9-87a1-fd36db05e7a5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:49 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 Apr 20 17:12:49 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-quobyte-cf46b165-020a-4fb9-87a1-fd36db05e7a5" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-cf46b165-020a-4fb9-87a1-fd36db05e7a5" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a688007d-e837-4dee-8cff-46b135c0bcbb]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:49 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 Apr 20 17:12:49 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:49 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 1.148s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Deleted volume successfully. Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-ede9f0b8-f7ae-4793-80f2-011b55d9274e tempest-CreateVolumesFromImageTest-49583856 None] Lock "cinder-708d7fa4-1e44-4647-9cdf-ec41f5388c3d-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:49 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.660s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:49 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Deleted volume successfully. Apr 20 17:12:49 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-4d6f0dd1-2162-4912-9358-4e4a553bf5da tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-99d24075-75b5-4f65-9232-177fe818f104-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:50 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85" returned: 0 in 0.783s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:12:50 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Converted 1024.00 MB image at 423.22 MB/s Apr 20 17:12:50 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 is being set with open permissions: ugo+rw Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:50 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 Apr 20 17:12:50 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:50 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5" returned: 0 in 0.713s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:50 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5 Apr 20 17:12:50 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:50 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" returned: 0 in 0.472s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" released by "_copy_volume_from_snapshot" :: held 4.787s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-5653cb6c-672e-4c51-93b6-633d67eea827-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" released by "_create_volume_from_snapshot" :: held 4.806s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.828s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.294s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-509219129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689e0173-e9f7-4557-9430-fb7089f1857d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aba5b1afc2c401ca3c45e11fa757983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:45Z,use_quota=True,user_id='cfc650150de34b74bdd05f9b1d3dcc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Creating volume 689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:50 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:50 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d 1073741824 Apr 20 17:12:50 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc7b5b3-b60e-420d-8982-9ed16f723de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9', 'volume_size': 1, 'snapshot_id': '5653cb6c-672e-4c51-93b6-633d67eea827'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7e3ea4-4503-49fc-94e2-ba1ec6e98107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:50 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Volume volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 (9d4f3886-6c5f-4605-ba21-7ec8086bbaa9): created successfully Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7e3ea4-4503-49fc-94e2-ba1ec6e98107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Flow 'volume_create_manager' (d501fc02-56b9-40ab-a216-f87dcf8063bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:50 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-2484687e-a054-4983-bce1-adca05023b8b tempest-VolumeDependencyTests-600852957 None] Created volume successfully. Apr 20 17:12:50 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-cf46b165-020a-4fb9-87a1-fd36db05e7a5" returned: 0 in 0.533s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-cf46b165-020a-4fb9-87a1-fd36db05e7a5" released by "delete_volume" :: held 1.270s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created reservations ['1b67c999-9646-4ba6-9319-f784ea6e2e09', '3629b855-2f4b-48ef-983a-f134188f3c32', 'be8ebdff-924a-46d9-b0f7-8000e5085ead', '02da9de7-3c8b-4914-a76c-cfd1aea7506a'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:50 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:50 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (fe6c7a3e-d40e-46e6-a4d7-7e88577d348a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4cc424-f662-419f-9800-6944b71b0dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4cc424-f662-419f-9800-6944b71b0dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795993883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd30399-a755-4d3a-9f83-62a34a17316c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:51Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cd20dd-492d-4137-ba22-0ff15cf2fbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cd20dd-492d-4137-ba22-0ff15cf2fbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:50 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc44099-83eb-454a-915b-492104829b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc44099-83eb-454a-915b-492104829b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd30399-a755-4d3a-9f83-62a34a17316c', 'volume_name': 'volume-2dd30399-a755-4d3a-9f83-62a34a17316c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3677f1c2-7c48-4565-996a-ae18c70511f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3677f1c2-7c48-4565-996a-ae18c70511f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021fc1dc-33f5-40c6-8601-5a33b010199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:51 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume 2dd30399-a755-4d3a-9f83-62a34a17316c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd30399-a755-4d3a-9f83-62a34a17316c', 'volume_size': 1} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-5653cb6c-672e-4c51-93b6-633d67eea827-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-5653cb6c-672e-4c51-93b6-633d67eea827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-7767701c-71cd-4cea-b832-259f036c1d85" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-7767701c-71cd-4cea-b832-259f036c1d85" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-5653cb6c-672e-4c51-93b6-633d67eea827" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-5653cb6c-672e-4c51-93b6-633d67eea827" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Deleting offline snapshot 5653cb6c-672e-4c51-93b6-633d67eea827 of volume 7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] snapshot_file for this snap is: volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3459777c-95a6-438b-a8a9-9072f1474c1c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:51 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 Apr 20 17:12:51 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:51 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d 1073741824" returned: 0 in 0.537s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:51 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d Apr 20 17:12:51 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:51 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.486s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:51 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Deleted volume successfully. Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-99dd136e-d4e2-4145-8cce-9b431cbf798b tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-cf46b165-020a-4fb9-87a1-fd36db05e7a5-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:51 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827" returned: 0 in 0.499s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7767701c-71cd-4cea-b832-259f036c1d85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e280d1-0326-44bc-ae69-94ab03d8f4a2]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-74883fdf-0d45-498c-a7bd-4dbeb32926b2-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-74883fdf-0d45-498c-a7bd-4dbeb32926b2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:51 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d" returned: 0 in 0.449s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795993883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd30399-a755-4d3a-9f83-62a34a17316c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:51Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Creating volume 2dd30399-a755-4d3a-9f83-62a34a17316c {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:51 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:51 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c 1073741824 Apr 20 17:12:51 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2249900a-0a22-4e17-926e-c873686fe020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689e0173-e9f7-4557-9430-fb7089f1857d', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c64dda0-ea57-4c80-bc09-84138ebf0db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:51 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 Apr 20 17:12:51 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-quobyte-74883fdf-0d45-498c-a7bd-4dbeb32926b2" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:51 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Volume volume-689e0173-e9f7-4557-9430-fb7089f1857d (689e0173-e9f7-4557-9430-fb7089f1857d): created successfully Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c64dda0-ea57-4c80-bc09-84138ebf0db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Flow 'volume_create_manager' (ec670689-4e10-4a42-b544-9e96417f5978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:51 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f3abe204-a0f2-43f7-95ce-62368e842632 tempest-SnapshotDependencyTests-1172258208 None] Created volume successfully. Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-74883fdf-0d45-498c-a7bd-4dbeb32926b2" acquired by "delete_volume" :: waited 0.023s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d318df26-44f4-4b0c-97e1-ff20d9588624]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:51 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:51 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 Apr 20 17:12:51 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:52 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85" returned: 0 in 0.576s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:52 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 Apr 20 17:12:52 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:52 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c 1073741824" returned: 0 in 0.566s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:52 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:52 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2 Apr 20 17:12:52 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:52 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c Apr 20 17:12:52 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:52 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827" returned: 0 in 0.473s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:52 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827 Apr 20 17:12:52 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:52 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-74883fdf-0d45-498c-a7bd-4dbeb32926b2" returned: 0 in 0.420s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:52 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c" returned: 0 in 0.419s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-74883fdf-0d45-498c-a7bd-4dbeb32926b2" released by "delete_volume" :: held 0.964s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021fc1dc-33f5-40c6-8601-5a33b010199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd30399-a755-4d3a-9f83-62a34a17316c', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fb1744-e26a-4aeb-8868-bfda761caebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:52 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume volume-2dd30399-a755-4d3a-9f83-62a34a17316c (2dd30399-a755-4d3a-9f83-62a34a17316c): created successfully Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fb1744-e26a-4aeb-8868-bfda761caebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (fe6c7a3e-d40e-46e6-a4d7-7e88577d348a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:52 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-7ac9a6e2-690d-4a04-a281-bb45edf8bc1a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created volume successfully. Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created reservations ['2525035a-9ea2-4f4d-9c80-a37adc1142a2', 'fd767d81-8a94-42b2-a2a6-8094fa480b21', '32a59802-b456-4c1d-8d24-3de7f1a986fc', '674907ac-a933-4c44-9651-0d3c1b4f490b'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:52 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:52 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Creating offline snapshot 70031ed9-f983-4f34-a15b-604ce6c37576 of volume 689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfad19d1-584d-4ad1-88d6-ae845e1a1581]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:53 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d Apr 20 17:12:53 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:53 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85.5653cb6c-672e-4c51-93b6-633d67eea827" returned: 0 in 0.487s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-5653cb6c-672e-4c51-93b6-633d67eea827" released by "_delete_snapshot" :: held 2.109s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-7767701c-71cd-4cea-b832-259f036c1d85" released by "delete_snapshot" :: held 2.122s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Created reservations ['87f2a4a0-0ad4-4873-add7-7333717e5a5b', 'fa2f281f-53a9-434a-a536-f8f868ceab19', '3bdcc754-235e-4542-acb4-bc7f681c3bdb', '64906e7e-14d2-4962-a00e-19e8473d1d60'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:53 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Delete snapshot completed successfully. Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6cb7f5e8-57ae-4cb0-8a7b-f239af88f5c8 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-5653cb6c-672e-4c51-93b6-633d67eea827-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:53 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.495s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:53 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Deleted volume successfully. Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-defef035-a27d-4e05-8da7-864f3a0bd294 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-74883fdf-0d45-498c-a7bd-4dbeb32926b2-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:53 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d" returned: 0 in 0.536s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:53 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 1G Apr 20 17:12:53 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-2dc54fa4-6409-427f-965b-65fc8768dbcc-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-2dc54fa4-6409-427f-965b-65fc8768dbcc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-quobyte-2dc54fa4-6409-427f-965b-65fc8768dbcc" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-2dc54fa4-6409-427f-965b-65fc8768dbcc" acquired by "delete_volume" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a4b35f-4c62-4975-9e92-24f1d88e7009]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:53 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc Apr 20 17:12:53 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:54 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 1G" returned: 0 in 0.490s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689e0173-e9f7-4557-9430-fb7089f1857d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:54 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689e0173-e9f7-4557-9430-fb7089f1857d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 Apr 20 17:12:54 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-7767701c-71cd-4cea-b832-259f036c1d85-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Lock "cinder-7767701c-71cd-4cea-b832-259f036c1d85-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-7767701c-71cd-4cea-b832-259f036c1d85" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-7767701c-71cd-4cea-b832-259f036c1d85" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b471da-a169-4b3b-97cb-a291f05515f0]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:54 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 Apr 20 17:12:54 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:54 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc" returned: 0 in 0.510s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:54 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc Apr 20 17:12:54 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:54 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689e0173-e9f7-4557-9430-fb7089f1857d -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576" returned: 0 in 0.452s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:54 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 is being set with open permissions: ugo+rw Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:54 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 Apr 20 17:12:54 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:54 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85" returned: 0 in 0.502s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:54 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85 Apr 20 17:12:54 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:54 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dc54fa4-6409-427f-965b-65fc8768dbcc" returned: 0 in 0.421s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-2dc54fa4-6409-427f-965b-65fc8768dbcc" released by "delete_volume" :: held 0.961s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created reservations ['7f761e20-a7da-45e5-9a7a-712c2211e8be', '939637ee-7a89-4b2e-abec-2763becce01a', '40ca5aeb-d2e0-49f9-a949-6db4e324fa33', '7ac91cc0-6d3c-4d12-963c-ba9e484674d4'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:54 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:54 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-e8ef0667-50d3-4346-a2b9-5211b6115867-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-e8ef0667-50d3-4346-a2b9-5211b6115867-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:54 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576" returned: 0 in 0.459s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "cinder-quobyte-e8ef0667-50d3-4346-a2b9-5211b6115867" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-e8ef0667-50d3-4346-a2b9-5211b6115867" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:55 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.info Apr 20 17:12:55 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a941f2b2-49b7-414f-a2f0-0e01e7dc449b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:55 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 Apr 20 17:12:55 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:55 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-7767701c-71cd-4cea-b832-259f036c1d85" returned: 0 in 0.469s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-7767701c-71cd-4cea-b832-259f036c1d85" released by "delete_volume" :: held 1.007s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Created reservations ['70e68668-b3b0-4030-94ad-bc16af334360', 'e65e32da-3c71-4b8b-bebb-a5e4538d205d', '2f232bd5-5d7d-4d84-8587-7b8c784aff3b', 'e5163cc5-e4ec-4e84-ab34-a25b20d486eb'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:55 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:55 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:55 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.486s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:55 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Deleted volume successfully. Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-73812a1d-bbe7-44c3-bcec-8bc664b8c1e0 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-2dc54fa4-6409-427f-965b-65fc8768dbcc-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:55 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.info" returned: 0 in 0.536s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:55 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.info is being set with open permissions: ugo+rw Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:55 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.info Apr 20 17:12:55 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:55 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867" returned: 0 in 0.524s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:55 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867 Apr 20 17:12:55 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:55 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.403s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:55 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Deleted volume successfully. Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-81d711f9-315b-4bcd-8d6d-c2622cf9c70c tempest-VolumeDependencyTests-600852957 None] Lock "cinder-7767701c-71cd-4cea-b832-259f036c1d85-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:55 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.info" returned: 0 in 0.411s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.755s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Creating offline snapshot 2cad99fb-d45f-4e1c-b251-a634b94e8dfa of volume 2dd30399-a755-4d3a-9f83-62a34a17316c {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0013e2f7-d58f-4160-96b3-5a8cb0d3ed81]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:55 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-e8ef0667-50d3-4346-a2b9-5211b6115867" returned: 0 in 0.436s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:56 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-31f436d4-0e35-4093-82ab-e75760d60b3f tempest-SnapshotDependencyTests-1172258208 None] Create snapshot completed successfully Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-quobyte-e8ef0667-50d3-4346-a2b9-5211b6115867" released by "delete_volume" :: held 0.987s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Created reservations ['aa0b2988-30dd-4342-8498-2a09cc2c17d7', 'a1e3a4e0-0185-4bda-93d5-7270f035b40c', '352f28da-4fab-45bb-a472-69119184bfed', '88fa03d4-4d6f-4869-ad30-74fe22c7f3c7'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:12:56 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c Apr 20 17:12:56 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:56 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:12:56 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:56 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c" returned: 0 in 0.529s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:56 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.447s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:12:56 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa 1G Apr 20 17:12:56 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:56 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Deleted volume successfully. Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Flow 'volume_create_manager' (676fc4e0-49cf-4356-b027-e2f32f506500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca0dfa7-b6bd-4fb9-9c7c-7675ea6036e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca0dfa7-b6bd-4fb9-9c7c-7675ea6036e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe198df9-5301-446a-920c-d8bb528dd621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aba5b1afc2c401ca3c45e11fa757983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70031ed9-f983-4f34-a15b-604ce6c37576,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:56Z,use_quota=True,user_id='cfc650150de34b74bdd05f9b1d3dcc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aca873f-fc7b-401f-8a46-da0337cfe007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aca873f-fc7b-401f-8a46-da0337cfe007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69478cc6-ce73-4cf9-9651-bdaf9b77c248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69478cc6-ce73-4cf9-9651-bdaf9b77c248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe198df9-5301-446a-920c-d8bb528dd621', 'volume_name': 'volume-fe198df9-5301-446a-920c-d8bb528dd621', 'volume_size': 1, 'snapshot_id': '70031ed9-f983-4f34-a15b-604ce6c37576'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5af31dd-988d-4b77-b5bf-9c270c6ac6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5af31dd-988d-4b77-b5bf-9c270c6ac6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63238cb1-ae04-46e9-912e-3a8b2a5243bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Volume fe198df9-5301-446a-920c-d8bb528dd621: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe198df9-5301-446a-920c-d8bb528dd621', 'volume_size': 1, 'snapshot_id': '70031ed9-f983-4f34-a15b-604ce6c37576'} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-40523cfd-536f-4198-ae44-fdc9bfada494 tempest-CreateVolumesFromSourceVolumeTest-1288428995 None] Lock "cinder-e8ef0667-50d3-4346-a2b9-5211b6115867-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Flow 'volume_create_manager' (ce5fb6c5-f9d1-45b0-a344-9daf79b65ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3470da3-fbd5-4cc9-b4dd-bc5133d3aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3470da3-fbd5-4cc9-b4dd-bc5133d3aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1164251445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3153e6716d8c4ae7a9322027a2997cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:57Z,use_quota=True,user_id='f2c2b8971e13437e9f0382dc762e07ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c82954b-c48d-4896-a765-9ee77f137bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c82954b-c48d-4896-a765-9ee77f137bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7d2807-3299-4f20-9528-061da6b397a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7d2807-3299-4f20-9528-061da6b397a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54', 'volume_name': 'volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ade483-82ce-4013-b0a1-0c17204f2214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ade483-82ce-4013-b0a1-0c17204f2214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6d59ba-cf87-4641-bbe3-391569dd8f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:56 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Volume f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54', 'volume_size': 1} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:56 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa 1G" returned: 0 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:56 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd30399-a755-4d3a-9f83-62a34a17316c -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:57 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd30399-a755-4d3a-9f83-62a34a17316c -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa Apr 20 17:12:57 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:57 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd30399-a755-4d3a-9f83-62a34a17316c -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa" returned: 0 in 0.487s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:57 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa is being set with open permissions: ugo+rw Apr 20 17:12:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:57 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa Apr 20 17:12:57 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:57 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa" returned: 0 in 0.487s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:57 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:58 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.info Apr 20 17:12:58 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:58 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.info" returned: 0 in 0.432s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:58 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.info is being set with open permissions: ugo+rw Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:58 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.info Apr 20 17:12:58 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Flow 'volume_create_manager' (7abca978-3cc5-49d3-a326-d7890ad50126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df918e8a-7aaf-4628-a406-cb86a3b0ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df918e8a-7aaf-4628-a406-cb86a3b0ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1004f619-ab34-4126-b9fd-0bd8e7495041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac6b958b3ec475f86a09e6681afb6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:59Z,use_quota=True,user_id='56b830817506439cac18a069283ab924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61718e30-4fe8-46e2-b5c8-44dd98f94eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61718e30-4fe8-46e2-b5c8-44dd98f94eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d488bd61-6a21-42ce-a575-9c6533c61e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d488bd61-6a21-42ce-a575-9c6533c61e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1004f619-ab34-4126-b9fd-0bd8e7495041', 'volume_name': 'volume-1004f619-ab34-4126-b9fd-0bd8e7495041', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58dc6ff-c6cc-4338-a1ce-68a77b3543cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:58 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58dc6ff-c6cc-4338-a1ce-68a77b3543cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191dee34-ad77-46dc-8a9e-d61179624aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:58 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Volume 1004f619-ab34-4126-b9fd-0bd8e7495041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1004f619-ab34-4126-b9fd-0bd8e7495041', 'volume_size': 1} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.info" returned: 0 in 0.441s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.914s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.262s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-quobyte-70031ed9-f983-4f34-a15b-604ce6c37576-fe198df9-5301-446a-920c-d8bb528dd621" by "_create_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-70031ed9-f983-4f34-a15b-604ce6c37576-fe198df9-5301-446a-920c-d8bb528dd621" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Creating volume fe198df9-5301-446a-920c-d8bb528dd621 from snapshot 70031ed9-f983-4f34-a15b-604ce6c37576 {{(pid=82240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-quobyte-fe198df9-5301-446a-920c-d8bb528dd621" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:12:58 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-62b15349-47e2-4772-b859-017601c51360 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Create snapshot completed successfully Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-fe198df9-5301-446a-920c-d8bb528dd621" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] snapshot: 70031ed9-f983-4f34-a15b-604ce6c37576, volume: fe198df9-5301-446a-920c-d8bb528dd621, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b648e2b2-bf92-401c-8dc8-7f2fdecc6128]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:59 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 Apr 20 17:12:59 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:59 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576" returned: 0 in 0.472s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689e0173-e9f7-4557-9430-fb7089f1857d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5994e2-1d22-499c-8a9f-737254a0f8ee]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:59 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d Apr 20 17:12:59 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (f64e7a33-b3e2-4680-aa75-68818b509619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c4b5fd-4406-4f68-9a54-bcb2070fdc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c4b5fd-4406-4f68-9a54-bcb2070fdc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-925783796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319c38a3-e099-40a4-a643-9ab45cd32baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29539c27-02f1-431f-9e84-ff2d07afd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29539c27-02f1-431f-9e84-ff2d07afd357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289134c2-b698-483d-840d-39ebb2e358ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289134c2-b698-483d-840d-39ebb2e358ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319c38a3-e099-40a4-a643-9ab45cd32baf', 'volume_name': 'volume-319c38a3-e099-40a4-a643-9ab45cd32baf', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c95fa9-975a-43b8-a417-f00c7211e58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c95fa9-975a-43b8-a417-f00c7211e58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0fddc9-591e-4cbb-b6bd-9fb3058b390b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume 319c38a3-e099-40a4-a643-9ab45cd32baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319c38a3-e099-40a4-a643-9ab45cd32baf', 'volume_size': 1} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (d781f756-276f-4025-b265-f614c94e9e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbb466e-bf04-44ce-8cd6-f3e6db8e612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbb466e-bf04-44ce-8cd6-f3e6db8e612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645031623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c260c0d-e85c-4460-a362-e815524b51d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5c2c55-7e00-4229-bf56-26393dd85ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5c2c55-7e00-4229-bf56-26393dd85ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f25f5a-9784-400e-9345-c605a20dbc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f25f5a-9784-400e-9345-c605a20dbc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c260c0d-e85c-4460-a362-e815524b51d3', 'volume_name': 'volume-2c260c0d-e85c-4460-a362-e815524b51d3', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d5b3ac-d286-484e-b195-8a0631495c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d5b3ac-d286-484e-b195-8a0631495c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff82efd-84e6-420d-9435-a705730182d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:12:59 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume 2c260c0d-e85c-4460-a362-e815524b51d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c260c0d-e85c-4460-a362-e815524b51d3', 'volume_size': 1} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:12:59 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d" returned: 0 in 0.529s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:12:59 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:12:59 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 Apr 20 17:12:59 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (3a0c026e-7143-46ba-8b07-27ed7500cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b21694-a611-4aac-99b2-81dd4077b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b21694-a611-4aac-99b2-81dd4077b509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396447718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288a1105-ae6e-422c-9d52-67ecdd8fcab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76f43a0-71ea-4d88-90b3-fba138cff663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76f43a0-71ea-4d88-90b3-fba138cff663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a03fd0b-cfde-4ec2-8fc7-0edb8de7930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a03fd0b-cfde-4ec2-8fc7-0edb8de7930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '288a1105-ae6e-422c-9d52-67ecdd8fcab5', 'volume_name': 'volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747bf32f-72ae-4eba-805b-6473b8531427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747bf32f-72ae-4eba-805b-6473b8531427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7a0cea-dc7c-4360-bf26-b179f0fee8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume 288a1105-ae6e-422c-9d52-67ecdd8fcab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5', 'volume_size': 1} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (47a54377-9ccf-4868-ab5f-5a1baac0a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c9edc1-40ba-42ae-872e-41af1633b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c9edc1-40ba-42ae-872e-41af1633b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91601447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c4a999-7463-4718-9ab7-0367513df945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c56898-8ad8-4ebb-99bd-39c4d47f3125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c56898-8ad8-4ebb-99bd-39c4d47f3125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ad644f-9091-48db-8c5c-e1460e98ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ad644f-9091-48db-8c5c-e1460e98ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c4a999-7463-4718-9ab7-0367513df945', 'volume_name': 'volume-09c4a999-7463-4718-9ab7-0367513df945', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db312da5-c8ac-410c-835c-7a492fbe2d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db312da5-c8ac-410c-835c-7a492fbe2d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fa08ef-ec66-4fef-a758-fc8afa7c0ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume 09c4a999-7463-4718-9ab7-0367513df945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c4a999-7463-4718-9ab7-0367513df945', 'volume_size': 1} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (90bcb1a9-d44f-4b07-9e49-24ec09ff8891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dec11f-0c72-4e18-b0b4-0173c30e9f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dec11f-0c72-4e18-b0b4-0173c30e9f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037515169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa14e663-98ee-437d-9503-a11a3cf4e90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81eb3a10-9765-4fc7-8952-da6d952114bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81eb3a10-9765-4fc7-8952-da6d952114bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb84752f-be9b-4af8-879b-262f0a3f4750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb84752f-be9b-4af8-879b-262f0a3f4750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa14e663-98ee-437d-9503-a11a3cf4e90a', 'volume_name': 'volume-fa14e663-98ee-437d-9503-a11a3cf4e90a', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9723e4-b047-4acf-8a8b-281c5fbe1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9723e4-b047-4acf-8a8b-281c5fbe1922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cef8bf-a778-4a68-bbf2-1ada25d3d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:00 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume fa14e663-98ee-437d-9503-a11a3cf4e90a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa14e663-98ee-437d-9503-a11a3cf4e90a', 'volume_size': 1} Apr 20 17:13:00 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:02 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621" returned: 0 in 2.108s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:02 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa537f-c1ed-47d6-9894-c5f58faf3409]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:02 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d Apr 20 17:13:02 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:02 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d" returned: 0 in 0.577s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:02 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:13:02 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Converted 1024.00 MB image at 485.50 MB/s Apr 20 17:13:02 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 is being set with open permissions: ugo+rw Apr 20 17:13:02 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:02 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 Apr 20 17:13:02 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:03 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621" returned: 0 in 0.431s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-fe198df9-5301-446a-920c-d8bb528dd621" released by "_copy_volume_from_snapshot" :: held 4.175s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-70031ed9-f983-4f34-a15b-604ce6c37576-fe198df9-5301-446a-920c-d8bb528dd621" released by "_create_volume_from_snapshot" :: held 4.195s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.213s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.320s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1164251445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3153e6716d8c4ae7a9322027a2997cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:57Z,use_quota=True,user_id='f2c2b8971e13437e9f0382dc762e07ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Creating volume f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:13:03 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:03 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 1073741824 Apr 20 17:13:03 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63238cb1-ae04-46e9-912e-3a8b2a5243bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe198df9-5301-446a-920c-d8bb528dd621', 'volume_size': 1, 'snapshot_id': '70031ed9-f983-4f34-a15b-604ce6c37576'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee390dd9-018c-44a4-ab19-672dbeb8e16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:03 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Volume volume-fe198df9-5301-446a-920c-d8bb528dd621 (fe198df9-5301-446a-920c-d8bb528dd621): created successfully Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee390dd9-018c-44a4-ab19-672dbeb8e16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Flow 'volume_create_manager' (676fc4e0-49cf-4356-b027-e2f32f506500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:03 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b63049ce-9abe-492a-b1af-e96ceb74fd86 tempest-SnapshotDependencyTests-1172258208 None] Created volume successfully. Apr 20 17:13:03 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 1073741824" returned: 0 in 0.481s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:03 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:03 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 Apr 20 17:13:03 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:04 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" returned: 0 in 0.409s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.152s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1004f619-ab34-4126-b9fd-0bd8e7495041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac6b958b3ec475f86a09e6681afb6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:12:59Z,use_quota=True,user_id='56b830817506439cac18a069283ab924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Creating volume 1004f619-ab34-4126-b9fd-0bd8e7495041 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:13:04 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6d59ba-cf87-4641-bbe3-391569dd8f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136669b2-8635-47c1-be82-29b1af3f82a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:04 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 1073741824 Apr 20 17:13:04 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-70031ed9-f983-4f34-a15b-604ce6c37576-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:04 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Volume volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 (f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54): created successfully Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136669b2-8635-47c1-be82-29b1af3f82a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Flow 'volume_create_manager' (ce5fb6c5-f9d1-45b0-a344-9daf79b65ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-70031ed9-f983-4f34-a15b-604ce6c37576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-quobyte-689e0173-e9f7-4557-9430-fb7089f1857d" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-689e0173-e9f7-4557-9430-fb7089f1857d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-quobyte-70031ed9-f983-4f34-a15b-604ce6c37576" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:04 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-0311466f-160f-4c53-ac35-270f3774bd32 tempest-VolumeDependencyTests-600852957 None] Created volume successfully. Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-70031ed9-f983-4f34-a15b-604ce6c37576" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Deleting offline snapshot 70031ed9-f983-4f34-a15b-604ce6c37576 of volume 689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] snapshot_file for this snap is: volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bcda4e-058a-49a9-9a02-0801c54b4de1]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:04 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 Apr 20 17:13:04 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Flow 'volume_create_manager' (8cd0b71d-7e3c-4862-8d2b-5fc5b7612691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45b32c2-3325-4860-9a70-59a0835222d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45b32c2-3325-4860-9a70-59a0835222d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-521796988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ef09ad-f237-4621-95f2-e754ab3f945d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3153e6716d8c4ae7a9322027a2997cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:04Z,use_quota=True,user_id='f2c2b8971e13437e9f0382dc762e07ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48ba476-0a84-4301-9c32-f2b640adf123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48ba476-0a84-4301-9c32-f2b640adf123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95baf98-3251-4fc3-a1cd-cf4fef2b7ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95baf98-3251-4fc3-a1cd-cf4fef2b7ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b6ef09ad-f237-4621-95f2-e754ab3f945d', 'volume_name': 'volume-b6ef09ad-f237-4621-95f2-e754ab3f945d', 'volume_size': 1, 'source_volid': 'f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54', 'source_volstatus': 'available'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5412e6fd-7ea4-4506-a27b-7954c6285aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5412e6fd-7ea4-4506-a27b-7954c6285aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481dafa4-4fcc-4395-bd7f-9f4d8a829d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:04 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Volume b6ef09ad-f237-4621-95f2-e754ab3f945d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b6ef09ad-f237-4621-95f2-e754ab3f945d', 'volume_size': 1, 'source_volid': 'f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54', 'source_volstatus': 'available'} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:04 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 1073741824" returned: 0 in 0.567s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:04 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 Apr 20 17:13:04 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:04 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576" returned: 0 in 0.537s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689e0173-e9f7-4557-9430-fb7089f1857d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98dcf5e-c138-4185-84b5-658da3eb18dc]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:04 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:04 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d Apr 20 17:13:04 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:05 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041" returned: 0 in 0.409s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.334s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-925783796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319c38a3-e099-40a4-a643-9ab45cd32baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Creating volume 319c38a3-e099-40a4-a643-9ab45cd32baf {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:13:05 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191dee34-ad77-46dc-8a9e-d61179624aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1004f619-ab34-4126-b9fd-0bd8e7495041', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:05 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf 1073741824 Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc8c6f8-c2d2-4874-af7c-1352954b4e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:05 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:05 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Volume volume-1004f619-ab34-4126-b9fd-0bd8e7495041 (1004f619-ab34-4126-b9fd-0bd8e7495041): created successfully Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc8c6f8-c2d2-4874-af7c-1352954b4e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Flow 'volume_create_manager' (7abca978-3cc5-49d3-a326-d7890ad50126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:05 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-2818145d-a9d1-4805-8469-50176eb6da3e tempest-CinderUnicodeTest-876473556 None] Created volume successfully. Apr 20 17:13:05 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d" returned: 0 in 0.511s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:05 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 Apr 20 17:13:05 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=208,cinder:SELECT=166,cinder:INSERT=51,cinder:DELETE=22 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Flow 'volume_create_manager' (5e0fbdee-0f57-4f89-863c-234ba9300fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6875a41-03cb-4b50-bfbc-360a3d869720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6875a41-03cb-4b50-bfbc-360a3d869720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1705231466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8b2618-859c-41eb-b3ed-b47028e30de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac6b958b3ec475f86a09e6681afb6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:05Z,use_quota=True,user_id='56b830817506439cac18a069283ab924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48262dfd-127f-4389-9956-6885b990d0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48262dfd-127f-4389-9956-6885b990d0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd50f50b-9853-4709-9961-950b2c6d7435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd50f50b-9853-4709-9961-950b2c6d7435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8b2618-859c-41eb-b3ed-b47028e30de1', 'volume_name': 'volume-be8b2618-859c-41eb-b3ed-b47028e30de1', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bf57f5-7ec5-4360-bc8d-4c83fb45f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bf57f5-7ec5-4360-bc8d-4c83fb45f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc03cc3e-80c3-497e-b0d5-43f19f68e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:05 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Volume be8b2618-859c-41eb-b3ed-b47028e30de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8b2618-859c-41eb-b3ed-b47028e30de1', 'volume_size': 1} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:05 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf 1073741824" returned: 0 in 0.571s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:05 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf Apr 20 17:13:05 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:05 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576" returned: 0 in 0.514s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:05 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:05 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576 Apr 20 17:13:05 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:06 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf" returned: 0 in 0.397s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.151s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645031623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c260c0d-e85c-4460-a362-e815524b51d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Creating volume 2c260c0d-e85c-4460-a362-e815524b51d3 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:13:06 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0fddc9-591e-4cbb-b6bd-9fb3058b390b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319c38a3-e099-40a4-a643-9ab45cd32baf', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:06 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 1073741824 Apr 20 17:13:06 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db8e499-7317-453e-b066-ab2dff6a5d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume volume-319c38a3-e099-40a4-a643-9ab45cd32baf (319c38a3-e099-40a4-a643-9ab45cd32baf): created successfully Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db8e499-7317-453e-b066-ab2dff6a5d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (f64e7a33-b3e2-4680-aa75-68818b509619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:06 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-3cae2579-0821-4592-a2d7-a652bde342b1 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created volume successfully. Apr 20 17:13:06 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d.70031ed9-f983-4f34-a15b-604ce6c37576" returned: 0 in 0.435s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-70031ed9-f983-4f34-a15b-604ce6c37576" released by "_delete_snapshot" :: held 2.059s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-689e0173-e9f7-4557-9430-fb7089f1857d" released by "delete_snapshot" :: held 2.078s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Created reservations ['0bd91f86-9825-4127-a4b9-879395ea7f8d', '14964f4c-cf8a-4007-b83c-745f1ec5d1e8', '16709b98-4fed-4230-acb7-c58fffdc828e', '1434d6cc-e769-4d1f-8b63-d7baa8e5eec8'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:06 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Delete snapshot completed successfully. Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6db3039c-dea3-4107-a3b6-bc4784e43c48 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-70031ed9-f983-4f34-a15b-604ce6c37576-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:06 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 1073741824" returned: 0 in 0.498s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:06 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 Apr 20 17:13:06 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:06 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3" returned: 0 in 0.401s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.844s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396447718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288a1105-ae6e-422c-9d52-67ecdd8fcab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Creating volume 288a1105-ae6e-422c-9d52-67ecdd8fcab5 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:13:06 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff82efd-84e6-420d-9435-a705730182d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c260c0d-e85c-4460-a362-e815524b51d3', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:06 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0b46e4-6349-46e7-b1a4-7ce2c2f1f248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:06 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 1073741824 Apr 20 17:13:06 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:06 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume volume-2c260c0d-e85c-4460-a362-e815524b51d3 (2c260c0d-e85c-4460-a362-e815524b51d3): created successfully Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0b46e4-6349-46e7-b1a4-7ce2c2f1f248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (d781f756-276f-4025-b265-f614c94e9e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:07 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-f38902a6-e1f4-4d68-b6ac-978ce9f46bb6 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created volume successfully. Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-689e0173-e9f7-4557-9430-fb7089f1857d-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-689e0173-e9f7-4557-9430-fb7089f1857d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-quobyte-689e0173-e9f7-4557-9430-fb7089f1857d" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-689e0173-e9f7-4557-9430-fb7089f1857d" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee3a974-2bc3-4a83-86a6-05c40597bea0]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:07 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d Apr 20 17:13:07 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:07 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 1073741824" returned: 0 in 0.519s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:DELETE=19,cinder:UPDATE=248,cinder:SELECT=175,cinder:INSERT=53 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:07 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 Apr 20 17:13:07 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:07 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d" returned: 0 in 0.510s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:07 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d Apr 20 17:13:07 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:07 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5" returned: 0 in 0.449s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.690s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91601447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c4a999-7463-4718-9ab7-0367513df945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Creating volume 09c4a999-7463-4718-9ab7-0367513df945 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:13:07 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7a0cea-dc7c-4360-bf26-b179f0fee8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:07 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72751996-36c5-4d39-9f9f-83326316a574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:07 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 1073741824 Apr 20 17:13:07 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:08 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 (288a1105-ae6e-422c-9d52-67ecdd8fcab5): created successfully Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72751996-36c5-4d39-9f9f-83326316a574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (3a0c026e-7143-46ba-8b07-27ed7500cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:08 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-2549f1fa-4a53-4ba4-a13f-dc461d147cfb tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created volume successfully. Apr 20 17:13:08 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-689e0173-e9f7-4557-9430-fb7089f1857d" returned: 0 in 0.445s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-689e0173-e9f7-4557-9430-fb7089f1857d" released by "delete_volume" :: held 0.994s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Created reservations ['b6fe9337-d683-48ca-8433-9eee8a2f8be7', 'd1ae2b83-17ec-4b49-bf39-f4f54a0e3006', '3b15eb6d-3b89-4cef-a024-88d7e7a0dcf8', '62b989b6-13bb-4b96-ae23-5da951a09d92'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:08 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:08 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-fe198df9-5301-446a-920c-d8bb528dd621-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-fe198df9-5301-446a-920c-d8bb528dd621-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "cinder-quobyte-fe198df9-5301-446a-920c-d8bb528dd621" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-fe198df9-5301-446a-920c-d8bb528dd621" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e49c3-10c0-4547-8912-c063fed1fc28]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:08 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 Apr 20 17:13:08 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:08 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 1073741824" returned: 0 in 0.515s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:08 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 Apr 20 17:13:08 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:08 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.488s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:08 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Deleted volume successfully. Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-36b10848-4006-4256-b384-f2626fbd5d24 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-689e0173-e9f7-4557-9430-fb7089f1857d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:08 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621" returned: 0 in 0.512s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:08 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621 Apr 20 17:13:08 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:08 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945" returned: 0 in 0.451s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.468s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037515169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa14e663-98ee-437d-9503-a11a3cf4e90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7358aa7354e2083b2b2fb0272ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:00Z,use_quota=True,user_id='8a3426478d9e49bfa2dfb0565769e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Creating volume fa14e663-98ee-437d-9503-a11a3cf4e90a {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:13:08 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fa08ef-ec66-4fef-a758-fc8afa7c0ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c4a999-7463-4718-9ab7-0367513df945', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:08 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f720bd-b437-4165-8b6b-21488d699ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:09 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume volume-09c4a999-7463-4718-9ab7-0367513df945 (09c4a999-7463-4718-9ab7-0367513df945): created successfully Apr 20 17:13:09 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a 1073741824 Apr 20 17:13:09 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f720bd-b437-4165-8b6b-21488d699ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (47a54377-9ccf-4868-ab5f-5a1baac0a78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1f5a94dd-6451-4ffc-901a-626c7d1a9c02 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created volume successfully. Apr 20 17:13:09 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fe198df9-5301-446a-920c-d8bb528dd621" returned: 0 in 0.410s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-quobyte-fe198df9-5301-446a-920c-d8bb528dd621" released by "delete_volume" :: held 0.943s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Created reservations ['5352e51b-4880-4617-860d-c7280790f269', '76d8a9f7-0e42-4f62-98ad-006a00006c36', '30351ed2-eb40-4b71-b0c3-e7f3a301698f', 'd25501bd-39dc-4280-a72a-ca0fff829ef4'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:09 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:09 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:09 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a 1073741824" returned: 0 in 0.512s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:09 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a Apr 20 17:13:09 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:09 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.475s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:09 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Deleted volume successfully. Apr 20 17:13:09 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a1d3f4dd-a94d-4959-98b4-96669db8f675 tempest-SnapshotDependencyTests-1172258208 None] Lock "cinder-fe198df9-5301-446a-920c-d8bb528dd621-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:10 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a" returned: 0 in 0.525s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.466s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:10 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Cloning volume f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 to volume b6ef09ad-f237-4621-95f2-e754ab3f945d Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cef8bf-a778-4a68-bbf2-1ada25d3d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa14e663-98ee-437d-9503-a11a3cf4e90a', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b96e1a5-dda9-462d-a872-f7d94b42b04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Creating offline snapshot f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 of volume f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:13:10 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Volume volume-fa14e663-98ee-437d-9503-a11a3cf4e90a (fa14e663-98ee-437d-9503-a11a3cf4e90a): created successfully Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b96e1a5-dda9-462d-a872-f7d94b42b04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Flow 'volume_create_manager' (90bcb1a9-d44f-4b07-9e49-24ec09ff8891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[51127ba6-d912-43f7-adb8-77ce042ca34b]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:10 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-69b9b58d-0055-4d95-b1df-d0ea851d728a tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created volume successfully. Apr 20 17:13:10 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 Apr 20 17:13:10 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:10 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" returned: 0 in 0.538s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:10 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:10 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 1G Apr 20 17:13:10 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:11 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 1G" returned: 0 in 0.557s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:11 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 Apr 20 17:13:11 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-fa14e663-98ee-437d-9503-a11a3cf4e90a-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-fa14e663-98ee-437d-9503-a11a3cf4e90a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-quobyte-fa14e663-98ee-437d-9503-a11a3cf4e90a" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-fa14e663-98ee-437d-9503-a11a3cf4e90a" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e58f00c-1301-4409-9c60-c414f443d075]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:11 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a Apr 20 17:13:11 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:11 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" returned: 0 in 0.514s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:11 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 is being set with open permissions: ugo+rw Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:11 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 Apr 20 17:13:11 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:11 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a" returned: 0 in 0.582s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:11 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:11 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a Apr 20 17:13:11 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:12 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" returned: 0 in 0.516s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:12 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.info Apr 20 17:13:12 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:12 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-fa14e663-98ee-437d-9503-a11a3cf4e90a" returned: 0 in 0.461s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-fa14e663-98ee-437d-9503-a11a3cf4e90a" released by "delete_volume" :: held 1.065s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created reservations ['b2c7cab0-2773-47d3-a824-58e4e0b9d3b6', '1352f604-8ebd-4816-9df8-5271a934d5f5', '09f28560-7c6b-46d8-abe8-4ef51887ba8e', 'ae91f7b7-e260-45ef-a7bc-f0b87147acfa'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:12 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:12 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:12 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.info" returned: 0 in 0.458s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:12 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.info is being set with open permissions: ugo+rw Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:12 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.info Apr 20 17:13:12 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:12 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.483s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:12 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Deleted volume successfully. Apr 20 17:13:12 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f2243cb-2dde-486f-823d-4165412646bc tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-fa14e663-98ee-437d-9503-a11a3cf4e90a-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:13 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.info" returned: 0 in 0.444s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-b6ef09ad-f237-4621-95f2-e754ab3f945d" by "_copy_volume_from_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-b6ef09ad-f237-4621-95f2-e754ab3f945d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] snapshot: f5d82d50-6b8e-4de8-b86f-7e15c5c97c25, volume: b6ef09ad-f237-4621-95f2-e754ab3f945d, {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba8ba72-81d9-41ff-bfcd-d027a9dcc7f1]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:13 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 Apr 20 17:13:13 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-09c4a999-7463-4718-9ab7-0367513df945-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-09c4a999-7463-4718-9ab7-0367513df945-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-quobyte-09c4a999-7463-4718-9ab7-0367513df945" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-09c4a999-7463-4718-9ab7-0367513df945" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead61d13-d4fb-4de6-afe3-cd0ecd901a97]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:13 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 Apr 20 17:13:13 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:13 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" returned: 0 in 0.511s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Creating direct copy from snapshot {{(pid=82240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59af8f4-a6af-49b9-ae85-3b3f66873dcc]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:13 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:13 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 Apr 20 17:13:13 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:14 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945" returned: 0 in 0.556s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:14 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945 Apr 20 17:13:14 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:14 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" returned: 0 in 0.589s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG cinder.utils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Path /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d not found in is_blk_device check {{(pid=82240) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:14 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d Apr 20 17:13:14 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:14 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-09c4a999-7463-4718-9ab7-0367513df945" returned: 0 in 0.545s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-09c4a999-7463-4718-9ab7-0367513df945" released by "delete_volume" :: held 1.133s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created reservations ['c5e85185-64a8-4577-8ba6-d45cc017b2a4', '7ef22774-9267-4045-9533-8f05fc61163e', 'c29e534e-9690-48ff-b6c0-c6b13a572eca', '6d3f7497-5230-4b46-acba-af677554653e'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:14 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:14 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:14 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:15 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:15 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.839s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:15 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:15 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Deleted volume successfully. Apr 20 17:13:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a7dc2ec6-ebd6-4b7a-9f5e-1364b953a560 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-09c4a999-7463-4718-9ab7-0367513df945-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-288a1105-ae6e-422c-9d52-67ecdd8fcab5-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:15 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-288a1105-ae6e-422c-9d52-67ecdd8fcab5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-quobyte-288a1105-ae6e-422c-9d52-67ecdd8fcab5" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:16 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-288a1105-ae6e-422c-9d52-67ecdd8fcab5" acquired by "delete_volume" :: waited 0.022s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:16 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33b7f8c-4288-4ae3-9eed-60e02884de60]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:16 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 Apr 20 17:13:16 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:16 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d" returned: 0 in 2.531s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:16 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd950fb-69f1-4251-a091-51660f9fbcb2]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:16 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:16 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 Apr 20 17:13:16 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:17 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5" returned: 0 in 1.023s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:17 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5 Apr 20 17:13:17 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:17 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" returned: 0 in 0.624s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Image conversion details: src /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d {{(pid=82240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Apr 20 17:13:17 devstack cinder-volume[82240]: INFO cinder.image.image_utils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Converted 1024.00 MB image at 404.30 MB/s Apr 20 17:13:17 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d is being set with open permissions: ugo+rw Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:17 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d Apr 20 17:13:17 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:17 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-288a1105-ae6e-422c-9d52-67ecdd8fcab5" returned: 0 in 0.428s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-288a1105-ae6e-422c-9d52-67ecdd8fcab5" released by "delete_volume" :: held 1.491s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created reservations ['cf8dbeaa-fe9d-4e5c-90f4-ef6f09dc6b6a', 'c88f8679-1d44-445e-be58-de53fccc88c8', '643daa1c-4e1f-4306-9118-346818ce4cc5', '293aede6-797a-4a44-abb3-057317e52d96'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:17 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:17 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:17 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d" returned: 0 in 0.406s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-b6ef09ad-f237-4621-95f2-e754ab3f945d" released by "_copy_volume_from_snapshot" :: held 4.716s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Deleting offline snapshot f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 of volume f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] snapshot_file for this snap is: volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[256417db-b180-4ccc-af74-f72578d67c4f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:17 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 Apr 20 17:13:17 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:17 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.403s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:17 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:17 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Deleted volume successfully. Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-b94b42db-492a-4f03-a0b2-ec7bcf7ba0ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-288a1105-ae6e-422c-9d52-67ecdd8fcab5-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-2c260c0d-e85c-4460-a362-e815524b51d3-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-2c260c0d-e85c-4460-a362-e815524b51d3-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-quobyte-2c260c0d-e85c-4460-a362-e815524b51d3" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-2c260c0d-e85c-4460-a362-e815524b51d3" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[52964d0b-cd9b-49cf-b432-85db3783430a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:18 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 Apr 20 17:13:18 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:18 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" returned: 0 in 0.510s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3927ce-a35d-4561-9789-ed9e2e613fe7]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:18 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 Apr 20 17:13:18 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:18 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3" returned: 0 in 0.477s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:18 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3 Apr 20 17:13:18 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:18 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:18 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:18 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 Apr 20 17:13:18 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:19 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2c260c0d-e85c-4460-a362-e815524b51d3" returned: 0 in 0.433s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-2c260c0d-e85c-4460-a362-e815524b51d3" released by "delete_volume" :: held 0.931s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created reservations ['fd770c8b-0ce5-4974-a463-41c252f3dc50', 'bc4a266f-8bf9-4439-89a8-a2eb30454c8d', '95557733-ed66-4de6-b1c9-a5787b80d8bf', '30c15076-303d-487c-83de-8b8f916da024'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:19 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:19 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-319c38a3-e099-40a4-a643-9ab45cd32baf-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-319c38a3-e099-40a4-a643-9ab45cd32baf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-quobyte-319c38a3-e099-40a4-a643-9ab45cd32baf" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-319c38a3-e099-40a4-a643-9ab45cd32baf" acquired by "delete_volume" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b9fa98-0805-4810-9f23-3915db824c02]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:19 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf Apr 20 17:13:19 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:19 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" returned: 0 in 0.485s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:19 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25 Apr 20 17:13:19 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:19 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.484s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:19 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Deleted volume successfully. Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-fae4e27f-5083-47ae-8f8e-46d20507b569 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-2c260c0d-e85c-4460-a362-e815524b51d3-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:19 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf" returned: 0 in 0.504s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:19 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf Apr 20 17:13:19 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:19 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54.f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" returned: 0 in 0.437s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-f5d82d50-6b8e-4de8-b86f-7e15c5c97c25" released by "_delete_snapshot" :: held 1.965s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.847s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.306s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-20T15:13:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1705231466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8b2618-859c-41eb-b3ed-b47028e30de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac6b958b3ec475f86a09e6681afb6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:13:05Z,use_quota=True,user_id='56b830817506439cac18a069283ab924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6d95ea9-405d-409f-9381-23b9e4b0c579),volume_type_id=b6d95ea9-405d-409f-9381-23b9e4b0c579)}" {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Creating volume be8b2618-859c-41eb-b3ed-b47028e30de1 {{(pid=82240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Selected osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 as target Quobyte volume. {{(pid=82240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 20 17:13:19 devstack cinder-volume[82240]: INFO cinder.volume.drivers.remotefs [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] casted to osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0 Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 1073741824 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481dafa4-4fcc-4395-bd7f-9f4d8a829d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ef09ad-f237-4621-95f2-e754ab3f945d', 'volume_size': 1, 'source_volid': 'f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54', 'source_volstatus': 'available'}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:19 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 1073741824 Apr 20 17:13:19 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c33725-0055-48a7-8cd5-e6f848507e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:19 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Volume volume-b6ef09ad-f237-4621-95f2-e754ab3f945d (b6ef09ad-f237-4621-95f2-e754ab3f945d): created successfully Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c33725-0055-48a7-8cd5-e6f848507e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:19 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Flow 'volume_create_manager' (8cd0b71d-7e3c-4862-8d2b-5fc5b7612691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:19 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-31c2c3ce-6162-4081-8be4-13ae93cb634b tempest-VolumeDependencyTests-600852957 None] Created volume successfully. Apr 20 17:13:20 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-319c38a3-e099-40a4-a643-9ab45cd32baf" returned: 0 in 0.444s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-319c38a3-e099-40a4-a643-9ab45cd32baf" released by "delete_volume" :: held 0.966s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created reservations ['cfcd29f3-0e47-46a3-b7c7-64801c666cdc', 'b47fafee-ef19-415d-9ea8-34f084a65ee7', '99c2dc8a-c2e2-4c7e-b9a6-c14f3c4e0a3e', '7edae101-d4a7-4cac-b0f8-b7d41b4e4780'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:20 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:20 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-2cad99fb-d45f-4e1c-b251-a634b94e8dfa-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-2cad99fb-d45f-4e1c-b251-a634b94e8dfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-quobyte-2dd30399-a755-4d3a-9f83-62a34a17316c" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-2dd30399-a755-4d3a-9f83-62a34a17316c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-quobyte-2cad99fb-d45f-4e1c-b251-a634b94e8dfa" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-2cad99fb-d45f-4e1c-b251-a634b94e8dfa" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Deleting offline snapshot 2cad99fb-d45f-4e1c-b251-a634b94e8dfa of volume 2dd30399-a755-4d3a-9f83-62a34a17316c {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] snapshot_file for this snap is: volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[87be40bc-eaf5-4bbe-8f4a-18ebfd74dbf5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:20 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa Apr 20 17:13:20 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:20 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 1073741824" returned: 0 in 0.549s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:20 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 Apr 20 17:13:20 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9812c0-3d91-4940-90ea-545b66db7e9c]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:20 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.475s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Deleted volume successfully. Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-cb33fe4a-8411-448f-bdb3-6c855304b9ae tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-319c38a3-e099-40a4-a643-9ab45cd32baf-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:20 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 Apr 20 17:13:20 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:20 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa" returned: 0 in 0.529s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dd30399-a755-4d3a-9f83-62a34a17316c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40bc792-bbea-405e-95d9-2f6266252128]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:20 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1" returned: 0 in 0.451s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'} {{(pid=82240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc03cc3e-80c3-497e-b0d5-43f19f68e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8b2618-859c-41eb-b3ed-b47028e30de1', 'volume_size': 1}' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929182e7-6eec-4569-98fe-e023e8b9fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 20 17:13:20 devstack cinder-volume[82240]: INFO cinder.volume.flows.manager.create_volume [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Volume volume-be8b2618-859c-41eb-b3ed-b47028e30de1 (be8b2618-859c-41eb-b3ed-b47028e30de1): created successfully Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929182e7-6eec-4569-98fe-e023e8b9fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82240) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 20 17:13:20 devstack cinder-volume[82240]: DEBUG cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Flow 'volume_create_manager' (5e0fbdee-0f57-4f89-863c-234ba9300fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82240) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 20 17:13:20 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-ba876080-5408-4b41-88fa-240567d3112b tempest-CinderUnicodeTest-876473556 None] Created volume successfully. Apr 20 17:13:20 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c Apr 20 17:13:20 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:21 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" returned: 0 in 0.530s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:21 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54 Apr 20 17:13:21 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:21 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c" returned: 0 in 0.520s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:21 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa Apr 20 17:13:21 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Creating offline snapshot 6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd of volume be8b2618-859c-41eb-b3ed-b47028e30de1 {{(pid=82240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b29e0d9-32c3-43a6-81cb-ff224a7a8370]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:21 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" returned: 0 in 0.482s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54" released by "delete_volume" :: held 1.041s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Created reservations ['4994264d-d200-4082-a62d-00e59ffb39f3', '44b9f58c-beaa-451b-95e6-bf85bc3cc84b', 'ed11deb2-1744-4c83-9cd2-a073ce194a87', 'b05d1584-a7f5-4080-a85c-5201d3f60f4d'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:21 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 Apr 20 17:13:21 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:21 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:21 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:21 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa" returned: 0 in 0.508s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:21 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:21 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa Apr 20 17:13:21 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:22 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1" returned: 0 in 0.497s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd 1G {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:22 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd 1G Apr 20 17:13:22 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:22 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.436s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:22 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Deleted volume successfully. Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-71c47c1c-24b9-4dd3-82dc-8b3a0820cc30 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-f3bdc88f-c3d4-4c2d-89b5-ca16bded9f54-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:22 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c.2cad99fb-d45f-4e1c-b251-a634b94e8dfa" returned: 0 in 0.409s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-2cad99fb-d45f-4e1c-b251-a634b94e8dfa" released by "_delete_snapshot" :: held 2.017s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-2dd30399-a755-4d3a-9f83-62a34a17316c" released by "delete_snapshot" :: held 2.028s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created reservations ['4553b15e-6e86-4ea3-b3f4-af967a1cb7ca', 'cac9a5ef-2307-41b8-a39a-d6b6a2827cd6', 'd96f2f5c-194a-4590-916b-400d7cdc3297', 'e667d04f-56e3-4a14-89ec-7afbc17de405'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:22 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Delete snapshot completed successfully. Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-eacff35e-87f4-4d2a-9eb9-6f237fcadf81 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-2cad99fb-d45f-4e1c-b251-a634b94e8dfa-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:22 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd 1G" returned: 0 in 0.491s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8b2618-859c-41eb-b3ed-b47028e30de1 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:22 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8b2618-859c-41eb-b3ed-b47028e30de1 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd Apr 20 17:13:22 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-b6ef09ad-f237-4621-95f2-e754ab3f945d-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-b6ef09ad-f237-4621-95f2-e754ab3f945d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-b6ef09ad-f237-4621-95f2-e754ab3f945d" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-b6ef09ad-f237-4621-95f2-e754ab3f945d" acquired by "delete_volume" :: waited 0.010s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[34393012-827c-48e6-a281-25b083441070]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:22 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:22 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d Apr 20 17:13:22 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:23 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8b2618-859c-41eb-b3ed-b47028e30de1 -F qcow2 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd" returned: 0 in 0.439s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:23 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd is being set with open permissions: ugo+rw Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:23 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd Apr 20 17:13:23 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:23 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d" returned: 0 in 0.466s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:23 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d Apr 20 17:13:23 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-2dd30399-a755-4d3a-9f83-62a34a17316c-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-2dd30399-a755-4d3a-9f83-62a34a17316c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "cinder-quobyte-2dd30399-a755-4d3a-9f83-62a34a17316c" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-2dd30399-a755-4d3a-9f83-62a34a17316c" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[350d3fbf-a17e-4e46-adf7-2ffeec9228e2]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:23 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd" returned: 0 in 0.435s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:23 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.info Apr 20 17:13:23 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:23 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c Apr 20 17:13:23 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:23 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-b6ef09ad-f237-4621-95f2-e754ab3f945d" returned: 0 in 0.446s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-b6ef09ad-f237-4621-95f2-e754ab3f945d" released by "delete_volume" :: held 0.936s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Created reservations ['8ba652e0-bf3f-4e36-b14e-bf46afab1ee9', '509805d8-08fc-4c99-89b7-8b4a7c096e89', '02e496bb-1207-4363-a767-6dad6b68a461', '42db9b97-0ca6-42c3-b00e-8ab5c54e0c6b'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:23 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:23 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "cinder-quobyte-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:23 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" acquired by "delete_volume" :: waited 0.008s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[836aa0ea-0d22-4297-addd-4ceae436633f]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:24 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.info" returned: 0 in 0.476s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:24 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.remotefs [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.info is being set with open permissions: ugo+rw Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.info {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:24 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c" returned: 0 in 0.536s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:24 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.info Apr 20 17:13:24 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:24 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c Apr 20 17:13:24 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:24 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 Apr 20 17:13:24 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:24 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.480s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:24 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Deleted volume successfully. Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-39804b12-e4d7-4f2c-ac4d-90754f62c313 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-b6ef09ad-f237-4621-95f2-e754ab3f945d-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:24 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.info" returned: 0 in 0.412s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:24 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-160b85ef-088b-4fb2-8d73-62b3c7df2c8a tempest-CinderUnicodeTest-876473556 None] Create snapshot completed successfully Apr 20 17:13:24 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-2dd30399-a755-4d3a-9f83-62a34a17316c" returned: 0 in 0.449s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-quobyte-2dd30399-a755-4d3a-9f83-62a34a17316c" released by "delete_volume" :: held 1.020s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:24 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" returned: 0 in 0.528s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Created reservations ['c57fe41a-6087-4859-94f8-bca026a2d662', 'bffdbd3c-669d-40b1-85e2-ea2219f06f4e', 'a61bbcb0-b169-4273-9816-1e9b0708405d', '930b5433-65f9-4659-804f-527575aed4e8'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:24 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9 Apr 20 17:13:24 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:24 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:24 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "cinder-6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd-delete_snapshot" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "cinder-quobyte-be8b2618-859c-41eb-b3ed-b47028e30de1" by "delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-quobyte-be8b2618-859c-41eb-b3ed-b47028e30de1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "cinder-quobyte-6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd" by "_delete_snapshot" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-quobyte-6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Deleting offline snapshot 6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd of volume be8b2618-859c-41eb-b3ed-b47028e30de1 {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] snapshot_file for this snap is: volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd {{(pid=82240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c6b80-c286-4f19-b27a-6b4bfa06573e]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:24 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:24 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd Apr 20 17:13:24 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:25 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" returned: 0 in 0.473s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-quobyte-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9" released by "delete_volume" :: held 1.021s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Created reservations ['79500c92-d723-4b16-95ba-6bf533a9688d', 'e2e9073a-12da-40ca-9958-cbf0ed8e6a32', '9db41650-a1da-4a86-84b2-af177acdc32b', '76c12216-ae4f-4ce8-a851-40ba206fc138'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:25 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.485s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Deleted volume successfully. Apr 20 17:13:25 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:25 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-65de10b5-0e8c-40b3-aee5-b481922d6157 tempest-CreateVolumesFromSnapshotTest-1306509613 None] Lock "cinder-2dd30399-a755-4d3a-9f83-62a34a17316c-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:25 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd" returned: 0 in 0.505s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be8b2618-859c-41eb-b3ed-b47028e30de1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1d3d58-f50f-43dd-8b8f-a25b0395b77a]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:25 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 Apr 20 17:13:25 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:25 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.418s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:25 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Deleted volume successfully. Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-a39226df-a455-412f-89e4-892c45db03f2 tempest-VolumeDependencyTests-600852957 None] Lock "cinder-9d4f3886-6c5f-4605-ba21-7ec8086bbaa9-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:25 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1" returned: 0 in 0.509s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:25 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:25 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd Apr 20 17:13:25 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:26 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd" returned: 0 in 0.606s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:26 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd Apr 20 17:13:26 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:26 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:26 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1.6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd" returned: 0 in 0.509s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-quobyte-6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd" released by "_delete_snapshot" :: held 2.182s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:26 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-quobyte-be8b2618-859c-41eb-b3ed-b47028e30de1" released by "delete_snapshot" :: held 2.192s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:27 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Created reservations ['a70cec27-4a6c-444e-8d84-8cc319b65069', '52627c6e-1682-4088-abe4-3176d44e5e38', '3f7848d3-b624-4850-8c3b-77e75ed4c63c', '5a25dc3b-caf7-41fa-818e-5e78c6b649ae'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:27 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Delete snapshot completed successfully. Apr 20 17:13:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-1f42d08e-ee7b-4ead-abf7-5085528f09b2 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-6d4cc08b-57c2-4d1a-ae2c-5f8fcaab0acd-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "cinder-be8b2618-859c-41eb-b3ed-b47028e30de1-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-be8b2618-859c-41eb-b3ed-b47028e30de1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "cinder-quobyte-be8b2618-859c-41eb-b3ed-b47028e30de1" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:27 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-quobyte-be8b2618-859c-41eb-b3ed-b47028e30de1" acquired by "delete_volume" :: waited 0.009s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:27 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6d5f03-dc45-4c0c-88a7-bc5a810c7c83]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:27 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:28 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 Apr 20 17:13:28 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:28 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1" returned: 0 in 0.479s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:28 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1 Apr 20 17:13:28 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:28 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-be8b2618-859c-41eb-b3ed-b47028e30de1" returned: 0 in 0.417s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-quobyte-be8b2618-859c-41eb-b3ed-b47028e30de1" released by "delete_volume" :: held 0.925s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Created reservations ['8419e602-ce50-42d7-a1cf-70bde5f3ab50', '345266e2-d94c-4677-a6bd-24ceb58bc3c0', 'b507f9b4-69fc-432c-a364-10363f952dca', '7a1ab13a-1c14-4588-8fc7-c96bb2697253'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:28 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:29 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:29 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "cinder-1004f619-ab34-4126-b9fd-0bd8e7495041-delete_volume" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-1004f619-ab34-4126-b9fd-0bd8e7495041-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "cinder-quobyte-1004f619-ab34-4126-b9fd-0bd8e7495041" by "delete_volume" {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-quobyte-1004f619-ab34-4126-b9fd-0bd8e7495041" acquired by "delete_volume" :: waited 0.017s {{(pid=82240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo.privsep.daemon [-] privsep: reply[705001b2-9927-4509-8b85-2c97285cdbc5]: (4, 'qcow2') {{(pid=83323) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:29 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 Apr 20 17:13:29 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:29 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.450s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:29 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Deleted volume successfully. Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-6f9a6bbd-6cc9-4f58-afb3-f40e8f055ef3 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-be8b2618-859c-41eb-b3ed-b47028e30de1-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:29 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041" returned: 0 in 0.509s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:29 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041 Apr 20 17:13:29 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo_service.periodic_task [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82240) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:29 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:30 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:30 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:30 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2/volume-1004f619-ab34-4126-b9fd-0bd8e7495041" returned: 0 in 0.446s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-quobyte-1004f619-ab34-4126-b9fd-0bd8e7495041" released by "delete_volume" :: held 0.977s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG cinder.quota [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Created reservations ['85319a37-fcae-4d6e-9917-fd83e0bbf06c', '91435062-4cb6-4fc4-9267-1c131990cf03', 'd1052807-d385-476a-869e-058616e37f93', '01db2755-2b73-43eb-87cf-f7ed59f52f14'] {{(pid=82240) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2e42441-efed-478e-bb75-a1cc55ce88c0'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 20 17:13:30 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2 Apr 20 17:13:30 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 20 17:13:30 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.448s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-751cc25a-866f-451f-8cef-ca91fd836810 None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:30 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03492a71be993d2b082471a582c56df2" returned: 0 in 0.416s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 20 17:13:30 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Deleted volume successfully. Apr 20 17:13:30 devstack cinder-volume[82240]: DEBUG cinder.coordination [None req-c948305d-329f-4b1e-8def-62078389b595 tempest-CinderUnicodeTest-876473556 None] Lock "cinder-1004f619-ab34-4126-b9fd-0bd8e7495041-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82240) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 20 17:13:40 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:UPDATE=145,cinder:DELETE=9,cinder:SELECT=82,cinder:INSERT=30 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 20 17:13:40 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writing DB stats cinder:SELECT=96,cinder:UPDATE=126,cinder:DELETE=12,cinder:INSERT=42 {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}